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Preface 


Solving linear matrix equations has experienced decades of development and has 
become a relatively mature scientific field. The study of linear matrix equations 
needs to focus on two important elements: one is the sufficient condition or necessary 
and sufficient condition of the linear matrix equation having a solution; the other is 
the explicit solution expression or iterative algorithm formula. The topic on linear 
matrix equations includes the solvable conditions of linear matrix equations, mainly 
including sufficient conditions and necessary and sufficient conditions; explicit 
method of linear matrix equations; iterative algorithms of linear matrix equations 
and comparison with various types of existing algorithms in time and accuracy; the 
application of linear matrix equation in the field of control. The knowledge of linear 
matrix equations is becoming more and more necessary. It has been applied in many 
engineering branches, such as robust control, observer design, and attitude control of 
spacecraft. 

This book is written for a wider audience and has three main purposes. Firstly, for 
researchers who want to consider the linear matrix equation, but lack of the 
knowledge about linear matrix equations. In this case, this book can be used as a 
primer book. Secondly, this book can provide its control model for researchers who 
have many important and good research results in the field of the linear matrix 
equation. Thirdly, this book provides textbooks or reference books for graduate 
students in related fields. In order to achieve the above purpose, this book provides 
two types of iterative algorithms for some linear matrix equations, which are used to 
find the numerical solutions and least squares solutions of several types of linear 
matrix equations, and provides an explicit method for several types of linear matrix 
equations. 

This book has several characteristics: Firstly, the book contains a number of 
recent research results, giving a finite iterative algorithm for coupled operator 
matrix equations with sub-matrix constraints and a least squares iterative algorithm 
for coupled operator matrix equations. Secondly, the control model and the appli- 
cation of the algorithm to the linear matrix equation are given. The iterative 
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algorithms and explicit solutions provided in this book are very useful for further 
research on control problems. This book is not only easy to understand, but also 
provides a large number of cybernetic models and numerical examples to illustrate 
the superiority and practicality of the algorithm. 


Caiqin SONG 
July 29, 2021 


Notations 


€: the set of all complex numbers 

R: the set of all real numbers 

R”X”: the set of all the real matrix m x n 

c”*": the set of all the complex matrix m x n 

A: the conjugate of matrix A 

AT; the transpose of matrix A 

A*: the conjugate transpose of matrix A 

A7!. the inverse of matrix A 

In: the identity matrix with n x n 

Omxn: the zero matrix with m x n 

det(A): the determinant of matrix A 

r(A): the rank of matrix A 

tr(A): the trace of matrix A 

p(A): the spectral radius of matrix A 

2(A): the set of character value on matrix A 

||a||,: Euclid length of vector z 

|| Al|,: the spectral norm of matrix A 

|| All: the Frobenius norm of matrix A 

A> B: represents A and B with same size satisfying ay > bi 
U: Collective union 

N: Collection of crosses 

0: empty set 

<=>: equivalence 

ai the ith column of A 

vec (A) = (a7, aZ,..., al)", the vec operator of matrix A 
(A, B): the inner product of matrices A and B 
LCO™*™P*4; the set of linear operators from C™*” onto C?*4 
T: the identity operator on C™*” 

I[1, N]:the integer set from 1 to N 
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Chapter 1 
Introduction 


In this book, we will derive three parts to consider the solutions to linear equations. 
They are finite iterative algorithms to the linear matrix equations, MCGLS iterative 
algorithms to the linear matrix equations, and explicit solutions to the linear matrix 
equations, respectively. 


1.1 The First Part: Finite Iterative Algorithm to Linear 
Matrix Equation 


In chapter 2, we consider a finite iterative algorithm to the coupled 
Sylvester-transpose matrix equations. It is well-known that Sylvester and Lyapunov 
matrix equations are very important since they play a fundamental role in the 
various field of engineering theory, particularly in control systems. The numerical 
solutions of Sylvester and Lyapunov matrix equations have been addressed in a large 
number of literature. Zhou and Duan”?! established the solutions of several gen- 
eralized Sylvester matrix equations. Zhou et al. [a] proposed a gradient-based itera- 
tive algorithm for solving the general coupled Sylvester matrix equations with 
weighted least squares solutions. In!!, the general parametric solutions to a family of 
generalized Sylvester matrix equations arising in linear system theory was presented 
by using the so-called generalized Sylvester mapping which had some elegant 
properties. With the help of the Kronecker map, Wu et al. (1 introduced a complete, 
general, and explicit solution to the Yakubovich matrix equation V — AVF = BW, 
with F in an arbitrary form. Also using the Kroneker map, an explicit solution for 
the matrix equation XF — AX = C was established". 

Moreover, Ding and Chen presented the hierarchical gradient iterative 
(HGI) algorithms for general matrix equations!'°'!) and hierarchical least squares 
iterative (HLSI) algorithms for generalized coupled Sylvester matrix equations and 
general coupled matrix equations!!?*!), The HGI algorithms!!!) and HLSI algo- 
rithms!!°!5-“4] for solving general (coupled) matrix equations are innovational and 
computationally efficient numerical ones and are proposed based on the hierarchical 
identification principle!!?!) which regards the unknown matrix as the system 


DOI: 10.1051/978-2-7598-3102-9.c001 
© Science Press, EDP Sciences, 2023 


2 Solutions to Linear Matrix Equations and Their Applications 


parameter matrix to be identified. nli, Dehghan and Hajarian proposed an iter- 


ative algorithm for solving the second-order Sylvester matrix equation 


EVF? — AVF — CV = BW. (1.1.1) 


Recently Dehghan and Hajarian!!” 0 introduced several iterative methods to 


solve (coupled) matrix equations such as (coupled) Sylvester matrix equations over 
reflexive, anti-reflexive, and generalized bisymmetric matrices. 

In chapter 3, we consider the finite iterative algorithm to the coupled operator 
matrix equations with sub-matrix constrained. Chen"®! puts forward the applica- 
tions of the generalized centrosymmetric matrix in three major areas: the altitude 
estimation of a level network, an electric network, and the structural analysis of 
trusses. Coupled matrix equations have numerous applications in stability theory, 
control theory, perturbation analysis, signal processing, and image restoration. For 
example, in stability analysis of linear jump systems with Markovian transitions, the 
continuous-time coupled Lyapunov matrix equations 


N 
ATPi+ PiAi+Qi+ >> pyP;=0, Q;>0, i€ If, NI, (1.1.2) 
j=l 
and 
N 
p= AT (>> pyP)) Ait+Q;, Q;>0,i€ J[1, NI, (1.1.3) 
j=l 
58,65,138] 


are often encountered! , where P; >0,i€ J[1,N] are the matrices to be 
determined. The coupled Sylvester matrix equations arise in computing error 
bounds for eigenvalue and eigenvalue space of the generalized eigenvalue problem?) 


A -C D -F 
s-ar (4 “£)-i(? F) T 
in computing deflating subspace of the same problem, and in computing certain 
decomposition of the transferable matrix arising in control theory. 

Many papers have studied several matrix equationsls18-35:36,38,40,43-46,51,52,56,66,76, 
100.126] But with the development of economy, science, and technology, many 
researchers pay close attention to transpose matrix equations and conjugate matrix 
equations. Sylvester transpose matrix equation can be used to solve many control 
problems such as pole assignment la p eigenstructure assignment (01166 165). and robust 
fault detection ®”. Recently, inl, minimal residual method was reported for solving 
CT Sylvester matrix equations and DT Sylvester matrix equations. Tril O REN 
finite iterative algorithm was constructed for solving the second-order Sylvester 
matrix equation EVF? — AVF — CV = BW. Im“, Wang investigated the 
centrosymmetric solution to the matrix equation systems A,X = C1, A3XB3 = C3. 
Moreover, some necessary and sufficient conditions, parameterize general solution 
and the maximal and minimal ranks of the general solution to the mixed Sylvester 
matrix equations and coupled Sylvester matrix equations are investigated), 
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Generalized Sylvester matrix equation, quaternion matrix equation, and operator 
matrix equation have been studied!’ 7). 

By applying the so-called generalized Kroneker map which had some elegant 
properties, Wu et al." discussed the closed-form solution to the generalized 
Sylvester-conjugate matrix equation. Zhou and Duan! proposed a gradient-based 
iterative algorithm for solving general coupled Sylvester matrix equations arising in 
linear systems theory. By using the so-called generalized Sylverter mapping, right 
coprime factorization, and Bezout identity associated with the certain polynomial 
matrix, Zhou et al. el investigated the problem of parameterizing all solutions to the 
polynomial Diophantine matrix equation and the generalized Sylverter matrix 
equation. It is shown that the provided solutions can be parameterized as soon as 
two pairs of polynomial matrices satisfying the right coprime factorization and 
Bezout identity are obtained. Based on the conjugate gradient searching principle 
and its dual form, Li et al.P” presented two algorithms for solving the minimal norm 
least squares solution to a general linear equation ))/_, A;XB; + X C)X" Dj = E. 
Between these two methods, the first one is to minimize the spectral radius of the 
iteration matrix, and explicit expression for the optimal step size is obtained. The 
second one is to minimize the square sum of the F-norm of the error matrices 
produced by the algorithm. The solvability, existence of unique solution, closed-form 
solution and numerical solution of matrix equation X = Af(X)B+C with 
f(X) = XT, f(X) =X and f(X) = X”, where X was the unknown matrix, were 
investigated'*” ` In??l, the following matrix equation 


XC AiXBi+ X CjXTD; = E, (1.1.5) 
i=1 j=l 
was considered, where Aj, Bi, Cj, Di i= 1,...,r;j = 1,...,8, and E were some 


known constant matrices of appropriate dimensions and X was a matrix to be 


determined. Inf", the solution of the generalized Sylvester-transpose matrix 
equation AXB+CX'D=E was presented by the iterative algorithm. The 
Moore-Penrose generalized inverse was used in’ to study the matrix equation 


AX + XTB = C and the explicit solutions to this matrix equation were given. 


1.2 The Second Part: MCGLS Iterative Algorithm 
to Linear Matrix Equation 


In chapter 4, we present MCGLS iterative algorithm to the linear conjugate matrix 
equation. Many problems in mathematics, physics, and engineering lead to solving 
linear matrix equations. For instance, a digital filter can be characterized by state 
variable equations 


a(n+1) = Aa(n) + bu(n), (1.2.1) 


4 Solutions to Linear Matrix Equations and Their Applications 


and 
y(n) = cz(n) + du(n). (1.2.2) 
The solutions K and W of the Lyapunov matrix equations 
K = AKAT + bb", (1.2.3) 
and 
W = ATWA + cfc, (1.2.4) 


can analyzed the quantization noise generated by a digital filter’), The Lyapunov 
and (generalized) Sylvester matrix equations appear in robust control“, neural 
network'**! and singular system control'®°!, It can be shown that certain control 
problem, such as pole/eigenstructure assignment and observe design? 87 of (1.2.1), 
are closely related with the following generalized Sylvester matrix equation 


p 4 
Š 4:XB;+ >> C;YD; = E. (1.2.5) 
k=1 j=l 

So far many techniques have been implemented for obtaining solutions of various 
linear matrix equations?” 3739-4142,44,48-50,68.69] 1157] the least squares solution of 
the generalized Sylvester matrix equation 


AXB+ CYD = E, (1.2.6) 


was studied for symmetric arrowhead matrices with the least norm. By applying the 
hierarchical identification principle, Ding and Chen introduced gradient based 
iterative algorithms to solve (coupled) generalized Sylvester matrix equations, 
nonlinear systems!113.14,91,92] Recently, in OO some efficient extended 
conjugate gradient methods were proposed for solving the least squares solution 
of several linear matrix equations. Very recently, the matrix forms of CGS, 
BiCOR, CORS, Bi-CGSTAB and finite iterative methods were investigated for 
solving various linear matrix equations!”*9* 9°101104] Based on the idea of the 
paper a eee ea this chapter focuses on the goal of MCGLS algorithm 
for computing the least square solution of linear conjugate matrix equation. 

In chapter 5, based on the theory of chapter 5, we present MCGLS iterative 
algorithm for solving the generalized Sylvester conjugate transpose matrix equation. 
The generalized Sylvester conjugate transpose matrix equation refers to linear 
systems whose state evolution depends on both the state and its conjugate. Several 
reasons can be found to study this class of linear systems, for instance, they are 
naturally encountered in linear dynamical quantum systems theory and any 
real-valued linear systems with lower dimensions. Therefore, this kind of matrix 
equation has many applications in some fundamental problems such as state 
response, controllability, observability, stability, pole assignment, linear quadratic 
regulation, and state observer design ?:84105-112]_ So far many techniques have been 


implemented for obtaining solutions to various linear matrix equations!!!3- 119), 
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Recently, int+?%9093] some efficient extended conjugate gradient methods were 


proposed for solving the least squares solution of several linear matrix equations. 
Based on the idea of the paper Ae Sak ee rt rea e0 23-98], this chapter is concerned 
with the least square solution of the generalized Sylvester conjugate transpose 
matrix equation. 

In chapter 6, based on chapters 4 and 5, we consider the least squares solutions to 
coupled linear operator systems by using MCGLS iterative algorithm. The least 
squares problems have wide applications in particle physics and geology, digital 
image and signal processing, inverse Sturm—Liouville problem, inverse problems of 
vibration theory, and control theory!105109] 

As we all know, matrix equations often arise from control theory, system theory, 
and stability analysis Pree eal Many authors have received much attention on how to 
solve these matrix equations. Therefore, some different methods for solving matrix 
equations were established. The hierarchical identification principle was presented by 
Ding and Chen!!°413141 Tn order to solve coupled matrix equations, the 
gradient-based iterative algorithms were established by combining the hierarchical 
identification principle and the gradient iterative method of the simple matrix equa- 
tions??7024) For more references, one can refer ign ee eee ee 
To improve the previous result, Zhou developed the weighted least squares iterative for 
solving the coupled matrix equation inl“, 

Another important method for solving the least squares problem of matrix 
equations is the CGLS method. Originating from the conjugate gradient method, 
this method has become more popular. The reason of presented CGLS iterative 
method is that the residual and the relative error of our iterative algorithm are 
smaller than those of LSQR-M iterative algorithm[?®98-1251, 


1.3 The Third Part: Explicit Solutions to Linear Matrix 
Equation 


In chapter 7, we consider the explicit solution to the nonhomogeneous Yakubovich 
matrix equation. This nonhomogeneous Yakubovich matrix equation plays an 
important role in output regulator design for time-invariant linear systems!!!) and 
eigenstructure assignment for second-order linear systems|!30-131]_ Obviously, the 
well-known Yakubovich matrix equation 


X—AXB=CY, (1.3.1) 
and generalized Sylvester matrix equation 


AX — EXF = CY, (1.3.2) 


are the special cases of the nonhomogeneous Yakubovich matrix equation, 
respectively. If the coefficient matrices satisfy some relations, the generalized 
Sylvester matrix equation can be transformed into the Yakubovich matrix equation 
and the solutions to these two matrix equations are equivalent. As we have known, 
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the generalized discrete Sylvester matrix equation is closely related to many 
problems in conventional linear control system theory, such as pole/eigenstructure 
assignment design, Luenberger-type observer design, robust fault detection !!32:136197]_ 
and so on. Finding the complete parametric solutions to the matrix equation is df 
extreme importance because many problems are referred to as design freedom, such as 
robustness in control system design. 

Due to the above-mentioned applications, the generalized Sylvester matrix 
equations (1.3.1) and (1.3.2) have been studied by many authors. When the coef- 
ficient matrix F is in Jordan form, Duan’?! has proposed a complete parametric 
solution to the generalized Sylvester matrix equation (1.3.2). However, this solution 
is not in a direct, explicit form but in a recursive form. Meanwhile, when the matrix 
F is also in Jordan form and the matrix triple (E, A,B) is assumed to be 
R-controllable, Duan’?! has proposed a complete and explicit solution by applying 


the right coprime factorization of the input-state transfer function (sE — A) "B. For 
the generalized discrete Sylvester matrix equation (1.3.1), an explicit, analytical, 
and complete solution is obtained inb, WE, the proposed solution is in a very 
neat form and can Pe immediately obtained as soon as a series of matrices 
D;,i=0,1,...,@. In'4l , the explicit solution can be obtained by using the Kronecker 
map. The dual form ol the matrix equation (1.3.1), which is called the generalized 
Sylvester matrix equation, has also been well studied!34144:149] For instance, in!44] 
an analytical and restriction-free solution is established when the coefficient matrix 
F is in a Jordan form. In order to obtain this solution, it needs to computer an 
inversion, carries out an orthogonal transformation, and solve a series of linear 
equation groups. When the matrix F is also in Jordan form, two solutions of the 
matrix equation in) are proposed. One solution is in an iterative form, the other 
solution is in an explicit parametric form. In order to obtain the second explicit 
parametric solution, one needs to carry out a right coprime factorization of the 


polynomial matrix (s7 — A)~' B in the case of the eigenvalues of the Jordan matrix F 
being undetermined or a series of singular value decomposition when the eigenvalues 
of F are known. Moreover, some necessary and sufficient conditions, parameterize 
the general solution and the maximal and minimal ranks of the general solution to 
the mixed Sylvester matrix equations and coupled Sylvester matrix equations are 
investigated"! The matrix equations which are studied in the current paper have 
included many linear matrix equations as special cases, such as discrete Sylvester 
matrix equation, generalized Sylvester matrix equation, discrete Lyapunov matrix 
equation, and so on'®-134,144] The idea of the present chapter comes from the 
references |&23:133:134,139,142,145-150] 

In chapter 8, we consider the explicit solutions to the nonhomogeneous 
Yakubovich-transpose matrix equation. The matrix equations AX — XB = C 
and X—AXB=C play important role in stability theory and control 
theoryl!32140,143,151,152,165,170,171] When A = BT (the transpose of B), the matrix 
equations are the well-known Lyapunov matrix equation and Stein matrix equation. 
Many control problems, for example, pole assignment!1>3" 155] and eigenstructure 
assignment”, are closely related to the second-order nonhomogeneous generalized 
Sylvester matrix equation MXF? + DXF + KX = BY + R, where (X, Y) is a pair of 
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matrices to be determined and other matrices are the known matrices. 
When R=0, it becomes the second-order homogeneous matrix equation 
MXF? + DXF + KX = BY. Other matrix equations such as the coupled Sylvester 
matrix equations and the Riccati equation have also been found numerous appli- 
cations in control theory. For more related introduction, seel”?:156161] and the ref- 
erences therein. Furthermore, another kind of transpose matrix equation, for 
example, AX + XTB = C, AX + XTA" = B and AXB + CXT D = E, have received 
much attention in the literature over the past several decades’!:?224:120,162-164] Jņ 
these references, the necessary and sufficient conditions for the existence of solutions, 
the solvability and closed-form solutions of the above transpose matrix equations are 
obtained by using SVD, GSVD, Moore-Penrose generalized inverse method and 
iterative algorithm. 

In chapter 9, we consider the explicit solution to the generalized Sylvester matrix 
equation. In the field of linear algebra, there is another type of similarity which is 
called consimilarity. For two complex square matrices A and B, there exists a 
nonsingular complex matrix P such that A = P7! BP", Then A and B is called 
consimilarity. Consimilarity of complex matrices is referred to studying an antilinear 
operator for different bases in complex vector space. The consimilarity theory of 
complex matrices plays an important role in the research of modern quantum 
theory!!), For this reason, the complex matrix equations X — AXB= CY and 
AX — XB = CY have been respectively extended to complex conjugate matrix 
equation X — AXB = CY and AX — XB = CY by applying consimilarity. In the 
quaternion field, the consimilarity of quaternion matrices is also defined int, 
Similar to the linear matrix equation AX — XB = CY, the quaternion matrix 
equation XB — AX = CY has also been generalized to the quaternion j}conjugate 


matrix equation XB — AX = CY by applying consimilarity over the quaternion 
field. Traditionally, quaternion algebralt?17) has been extensively used in computer 
graphics!” and aerospace problems!”*) due to its compact notation, moderate 
computational requirements, and avoidance of singularities associated to 3 x 3 
rotation matrices!!”, So many researchers pay close attention to the quaternion 
matrix equation problem. For example, Ning and Wang!!®9l have studied the max- 
imal and minimal ranks of a 2 x 2 partitioned quaternion matrix. Huang!!*!! has 
established some necessary and sufficient conditions for the existence of a unique 
solution to the quaternion matrix equation 5$ AXB; = E. By applying the 
complex representation of the quaternion matrix, the Moore-Penrose generalized 
inverse, and the Kronecker product of matrices, the least squares solution of the 


quaternion jconjugate matrix equation X — AXB=C (where X denotes the 
#conjugate of quaternion matrix X) with the least normë”! has been discussed. 
Some necessary and sufficient conditions for the existence of the quaternion matrix 
equations AXB + CYD = E,(AX, XC) = (B, D), AXB = C, have been proposed 
and the solutions have been derived in the references!!*19!83), Song et al,!16°184) have 
studied the explicit solutions to the quaternion conjugate matrix equation 
X—AXB=C and XF- AR = CY, where the coefficient matrix A is a block 
diagonal form over a complex field. 
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In recent years, some other linear matrix equations and nonlinear matrix 
equations have also been attached. By using the so-called generalized Sylvester 
mapping, right coprime factorization, and Bezout identity associated with the 
certain polynomial matrix, Zhou et al. B1 have investigated the problem of 
parameterizing all solutions to the polynomial Diophantine matrix equation and the 
generalized Sylverter matrix equation. It is shown that the provided solutions can be 
parameterized as soon as two pairs of polynomial matrices satisfy the right coprime 
factorization. The solvability, existence of unique solution, closed-form solution, and 
numerical solution of matrix equation X = Af(X)B + C with f(X) = XT, f(X) = X 
and f(X) = X", where X is the unknown matrix, are investigated", A complete, 
general, and explicit solution® to the generalized Sylvester matrix equation 
AX — XF = BY, with the coefficient matrix F in a companion form, is proposed. By 
introducing and studying a matrix operator on complex matrices, some sufficient 
conditions and necessary conditions for the existence of positive definite solutions of 


the matrix equation X+ A” X A=" are also proposed. In addition, 
Wu et al.) have constructed some explicit expressions of the solution to the matrix 
equation AX — XB = Cand X — AXB = CY by applying the Kronecker map. It is 
shown that there exists a unique solution if and only if AA and BB have no common 
eigenvalues. 

In chapter 10, we consider the explicit solutions to the equations 


AX+XTB=C, (1.3.3) 
and 
AX4+X™B= CY, (1.3.4) 


where A, B, C € R”*” are given n x n real matrices and X, Y € R”*” are unknown 
nx n real matrices to be determined. There are named the Sylvester transpose 
matrix and the generalized Sylvester transpose matrix equation, respectively. If 
X = X", the equations (1.3.3) and (1.3.4) reduce to the well-known Sylvester (or 
generalized Sylvester) matrix equation, which has many important applications in 
control theory. Therefore, many researchers focus on the solutions to these two 
equations, for details, please see!’° *”!, Because (1.3.3) and (1.3.4) are obtained by 
changing the second unknown matrix of the (generalized) Sylvester matrix equation, 
they are called the (generalized) Sylvester transpose matrix equation. 

The traditional method for solving the equation (1.3.3) is to transformed it into 
its equivalent form Az = c, where A= I, ®A+(B? @In)Pnn, c= vec(C) and 
x = vec(X). Therefore, the unique solution to equation (1.3.3) can be obtained as 
z= Ac, Recently, a lot of methods have been constructed for calculating 
explicit solutions to (1.3.3) and are briefly classified as follows. 

The method of applying the matrix decomposition was given inl], The method 
by using GSVD, CCD, and projective theorem was presented to discuss the least 
square solution to the transpose equation AT XB+ BTXTA = D 62] The method of 
using a generalized inverse was proposed to investigate the explicit solution to the 
equation (1.3.3), Also, some solvability was provided for the equations 
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A*X+X*A= Band A*X+X*A=0 and the expressions of the solutions were 
given to the two matrix equations abovel!®?:!°l_ Some necessary and sufficient 
conditions were presented for the existing unique solution to the generalized 
*-Sylvester matrix equation and they were in terms of the Kronecker canonical form 
of the matrix pencil A+B", The solvability of the Sylvester matrix equation 
was provided by Desouza and Bhattacharyya!!! and it demonstrated that the 
solution existed if and only if A and B were similar. For a more related introduction, 
see!30:157,163,190°194] and the references therein. In addition, many works were devoted 
to calculating the numerical solutions to the Sylvester transpose equation. Here, we 
are not concerned with the numerical solutions to the linear transpose matrix 
equations and we suggested the readers to see!?*!29] and their references therein. 
Besides the topics above on linear matrix equations, some other topics were also 
focused on. For instance, the solutions to the (generalized) Sylvester matrix equa- 
tion over the real field, complex field, and quaternion field, for details, please 
geet! 21,22,50,145,149,195—201} 

However, the explicit solutions to the matrix equations (1.3.3) and (1.3.4) have 
not yet been given in the literature. The difficulty of solving equations (1.3.3) and 
(1.3.4) is that there are unknown matrices X and X". It is clear that the form of an 
unknown matrix is not united. Inspired py ere tees 188,199) in this chapter, we’ll 
adopt the Kronecker map and Sylvester sum to study explicit solutions to the 
equations (1.3.3) and (1.3.4). We’ll propose the solvability and necessary and suf- 
ficient conditions for these two equations. Moreover, we’ll offer three forms of 
solutions to equations (1.3.3) and (1.3.4) and one of the solutions is Jameson’s 
Theorem. We also establish the corresponding algorithms for the matrix equations 
above and two algorithms are proposed for solving the equation (1.3.3) when A or B 
is nonsingular. As the application of our presented algorithm, we give the design of 
the time-varying linear system in control theory. 

In short, this book wants to build a working platform for readers, provide a 
benchmark, and become a cornerstone for further learning, application, and devel- 
opment of matrix equations. The author is very talented and shallow, and omissions 
are inevitable. Readers and related experts are welcome to give us advice. 


Chapter 2 


Finite Iterative Algorithm to Coupled 
Transpose Matrix Equations 


In this chapter, we consider the following two problems of the coupled 
Sylvester-transpose matrix equations. 


Problem 2.1. Given matrices Aj, € Rrx, Biy E RP, Ciy E R™*™, Din € RIP 
and F; e R™”?: ic I[1, N], n € I[1, p], find the matrix group (X1, X2, . . ., Xp) with 
X, E€ R»*™ y € I[1, p] such that 
p 
Se By + Cok, Da) = En i=1,2,... p. (2.0.1) 


y=1 
Problem 2.2. Let problem 2.1 be consistent, and its solution group set is denoted by 


S,. For a given matrix group (Ri, Ro, Xp) with £, € R»*™ n € I[1, p], find 
(Xo Xass a) € S, with X, ERX" y € Il, p] such that 


' an2 
= min X.— XxX, , sna 
(xı a fY |X; jll | ( ) 


Intl the following linear equation 
XO AiXB;+ X C)XTD; = E, (2.0.3) 
i=1 j=l 
where Aj, Bi, Cj, Di i= 1,...,r; j= 1,...,8. and E were some known constant 


matrices of appropriate dimensions and X was a matrix to be determined, was 
considered. In?%l, the special case of (2.0.3), which was matrix equation 
AXB+ CX'D = E, was considered by an iterative algorithm. A more special case of 
(one), namely, the matrix equation AX + XTB = C, was investigated by Piao 
et al?" The Moore-Penrose generalized inverse was used in?) to find explicit 
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solutions to this matrix equation. Compared with the above references, in this 
chapter, we investigate the finite iterative algorithm to the matrix equation (2.1.1). 


2.1 Finite Iterative Algorithm and Convergence 
Analysis 


In this section, we consider the following coupled Sylvester-transpose matrix 
equations 


Pp 
S > (An Xn Bn + Cin Xq Din) = Fa i€ I1, N], (2.1.1) 
n=1 


where Ai, E R™™", Bin E RP, Cin ER™™™, Di E ROP, Fi E R™P ie IL, NI, 
n€I[l,p], are the given known matrices, and X, €R"*",n € I[l,p] are the 
matrices to be determined. 

When the matrix equations are consistent, we propose the following iterative 
algorithm to solve it. 


Algorithm 2.1 
Step 1. Input matrices Aj, € rin Bi E R™ Pi, Cy ER™™, Din € RaP 


F; c R™*™ ic Il, N], and arbitrary matrices X,(1) € R»*™, 1 € Ifl, pl; 
Calculate 


P 
R,(1) = Fi — X [AnX, (0) Big + Cn X (O) Dil, i € T1, N], 


N 
P,(1) = X C[AR RL) BF + Da RE (1) Cin], € TIL, p). 


i=l 
Step 2. If Ri(k) = 0,i € I[1, N] then stop; else, k = k+ 1. 
Step 3. Calculate 


Xo- ll Ro(K)|? 


X,(k+1) = X,(k 
a + Se UPC 


P,(k),n € J[1, p], 


Pp 
R(k+1) = Fi — S [Aig Xq(b+ 1) Bay + Cig Xp (E+ 1) Din] 
n=1 


— . De || Rook) ||? Z k . 
B PPIE 4 a 


+ Cn PF (k) Dil, i € TTL, T 
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N 
„(k +1) = X “(AP R(k+ IBF + Dip Rf (K+ 1) Ca] 
l 
y |Ro(k+1)|/ 
Do | Ro(k+ Dl P,(k) 


+ 
Dont Ul Roo)? 


se TL, p]. 


Step 4. Go to step 2. 


Now we introduce some properties of the algorithm above. 
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Lemma 2.1. Suppose that the sequences P,(k), n € I[1, p] and Ri(k), i € I[1, N] are 


generated by algorithm 2.1, then the following relation holds 


S inf RT (k+ 1) RC) 


n Xa IRI? S | 
= Y tr[R2(k)R; ot A MPP, 
as [R; (k) Ri] P PK] ar [Pi (4) PrO) 
N 2 
íl ee) | Reo (k Jl? sM, | Ro (D| | 2 Su „C _ 1)]. 


pall Pc(k IP ll foG =i) )I n=1 
Proof. Because all matrices in algorithm 2.1 are real, we can write 


Soin (k+1)R;(3)] 


Sl Rg) e SA | 
OR Spor ag APO Be 


2 
G Do IlRo(k)II 
i 2 
= Xi IPK) 
x J tr 
In addition, by applying some properties of the trace of a matrix one has 


2 tr 
Ci 


DEA in Pi (k )Aj, + Di, Pn (k) C7, Ri(9) 5 


n=1 


p 
ie TDIP OCF) RO) 


n=1 


tr] > (Pr (k) Ap Ril) Bj, + Pa(k) Cj, Ri(j)D 7) 


y=1 


(2.1.2) 
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By changing order of this double sum, one has from algorithm 2.1, 


N 


S ir[ Do (EPH WAS + DTPA (HCH) RA) 


i=1 =l 


-FefS (PTC) An RG) BE + Pa(k) CF RG)DE)| 


_ N 
=> tr[ PT) D> (APR) BE + Da RTG) Can) | 


= 4 | Rol B 1) 


p N +) 12 
= r pr k : ont I| Reo(9) I 
2 | a 0] Doa lR- DI? 


x XO rl PI (k) Pali - 1))]. 


N A 112 
PO (ro 2o | Ro(j)|| E P, »)| 
P 


Combining the preceding two relations gives the conclusion of this lemma. O 


Lemma 2.2. Suppose that the sequences {P,(k)},1 € J[1, p] and {R;(k)}, i € J[1, N] 
are generated by algorithm 2.1. If there exists an integer number g > 1, such that 


oN | Ri(k)|[? 4 0, for all k = 0,1,...,, then 


N 
YHA HRD] =0, J wlPZ)P»(H)] = 0. 


for all j,k=1,...,.9,j 4k. 


Proof. It is known that 


tr[ Ri (KRON = [RORE  trlP7(k)Py(a)] = trier O 


We only need to indicate that 


N 
Yo wR RD] = 0, J WLP TCP, = 0. 


for l<j<k<o@. 


(2.1.3) 


(2.1.4) 
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We apply induction to prove conclusion (2.1.4), and also we do it in two steps. 
Step 1. For j = 1, by using lemma 2.1 we can obtain 


N 
SWAP (2) Ri(0) 
N 2 P 
= >, tr[RT(1)R:(1)] Zo a es tr[P7 (1) P,(1)] 
N 
= SIRE = 0 Or DIPO =o. 
And from algorithm 2.1 one also has 
y tr| PT2) P0] 


-7 ir[( X AZRB + Dy RT) Ca)) Pa) 


n= {=l 


Zoa llRDIE 3 rP P, 
TS* ROE 2! [Pi OPD] 


p N 
= Y tr] Y (Ba RT O)An + CER(2)DE)P,0)] 


n=1 i=1 


Xoz ll RoI? Sea 
Eo lI Ro(1)I 2l nT 


= S4[Do (Pe) Py(1) Biy + R2) DZ PD Ca) | 


+ 


Zeger RoI ee 
Eo lI Ro(1IP 2 nT 


apy oes + RT) CPT(1)Day)| 


n=1 i=1 


Lig Rol)? S p 
t Xo || Rw (1)|| pe | „( 


= 2 ir[ RT(2) 3 (4inP(1) By F GaP EO Din) | 


II 
ey 


BO Ses nai 
+ Roe POI 


N p 2 
= r| R?(2)(R(1) — R;(2 Dever lP 
2 PORC) ~ Ri) Z ROI 
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DA RDPH ip yp 
es | Ro D)? z2 l in Il 


2 Dra PAOI | or RDI? 2 
=- Sy R,(2 = P,(1)\|? = 0. 
2 m Doa RDI? Zo- RDI? dl ci 


Step 2. In this step, it is assumed that 


N P 
D tr[R (RO= 0, X tr[PP(v) P, = 0, (2.1.5) 
Now we prove 
N P 
NO tr[R (vt DRA =0, X rP w+] = 0, (2.1.6) 


for 7 = 1,2,..., v. 
By applying lemma 2.1 and step 1, for j =1,2,...,v—1, it follows from the 
induction assumption (2.1.5), 


N N 
= = tr[R; (v) Ri(y)] _ we l? D (v v) P, (i| 
D || Ro ( v)? Da || Ro(J) r 
Eia PO Conall Rod - i T x Se 


In addition, it can be obtained from lemma 2.1 and induction assumption (2.1.5) 
that 


)P G- DJ] = 0. 


= M p 
P IPROAPE ZR- DI? E 


Eiio g 
PIPO $ Wolo DIP 


wl P (V) P (v —1)|=0. 
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It shows that the second relation in (2.1.6) holds for j = 1,2,..., v. From algo- 
rithm 2.1, it can also be obtained that 


=> abs (Aj Ril v+1)By + Dy R? (v+ 1) Cin) “P, (A) 


=l i=1 


t ae [Ro(v+ DI? y tr Hal 


De |Ro(v II? n=l 
p N 
= 3 upd (Bu RT (v+ 1A + CRR(v+ 1)DZ) P,O) 
y= = 


Dai | Rolv + 1)|? r pT Ire 
Di lR w)? 3 | n C) A| 


apy (RI (o+ 1) Ag Py (9) Bi + Rilo +1) DFP C Neg) 


n=l i=1 


| De || Rolv + Hi = r pT Ape 
Di || Bo w)? 2 | n (0) 1(0)| 


p N 
= tr 


J (RI W+ 1) AnP O) Bin + RT (0+1) CinP 7 (3) Din) 
N p 
e eE LS [PrO PO] 


i=l 
N 2 
reat || Ra(v)| n=1 


2 N 
= ir[AT(0+1) Y (AnP Bat Ca PTO Dy) 
i=1 


II 
Ny 


| 2 


+ 


Da | Rolv + D pT eee 
+ Ei Row)? 2" r| q (9) „()] 

Da PAP ` Tr T v (47) — i 
PoR Fe [R w+ 1) (Ril) - BiG +1)] 
am || Rolv + 1) 
DE || Ro(v)| 


From this relation, it follows from the induction (2.1.5) that the first relation in 
(2.1.6), for 7 = 1,2,...,v—1, can be written as 
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For j = v, from the above relation we have 


5 tr [PP w+ 1)P,(0)] 


n=1 


= LEIP (57 [ato DR] 


Eo lR Si 
— Fr] RP (w+ 1)Ri(v+ 1|) 


X ozi Ro 4 =1 
Da Ro(v+ D? 2 

Ea 2 > lP, o)l? = 0. 
Xo Role) ||" pat 


Thus the second relation in (2.1.6) holds for j = 1,2,...,v 
From steps 1 and 2, the conclusion is immediately obtained by the principle of 
induction. oO 


Lemma 2.3. Assume that the coupled Sylvester-transpose matrix equation (2.1.1) 
are consistent and let [X1,, X2x, ---, Xp] be their solutions. Then, for any initial 
matrices X,(1),7 € I[1, p], the sequences {X,,(k)}, {P,(k)},4 € I[1, p] and {R;(k)}, 
i € I[1, N], generated by algorithm 2.1 satisfy 

p 


N 
NO tr[ PI (K) (Xm — Xn (K) = >» |Ri(k)||?, &=1,2,... (2.1.7) 


n=1 


Proof. We prove the conclusion by induction. For i = 1, we have 


aie 


n=1 


p N 
= > | >> (BP Ain(Xys — X,(1)) Bin 
n=1 i=1 


+ RT (D) Ca (Xy — Xu(1))" Di) 
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ae Pann + Cy X7(1)Di))] 
a n=1 
po 


tr RP R 
N 

=) RJ. 

Now assume the conclusion (2.1.7) holds for k = n. Then we can get 
> 2 

S rlP 7 (Xr — Xa) = $ IRn) 
il 

It follows from algorithm 2.1 that 


3 tr| PF (n+ 1) (Xe — Xy(n+ 1))| 


p N 
=> ir] D> (BR? (n+1)An + CLR(n-+1)D2) 


x (Xp -x — X,(n+ 1))] 
poa RS 


= 
I 
& 
Fatt 
D 
=> 
i 
Re 
=h 
ae 
J 
oN 
x 
% 
| 
be 
= 
Fey 
z 
x 
hm 


In addition, we have 


5 aby (BinRT (n+l) Ain + CER(m+1)D2) x (Xp — Xq(n+1))] 


=i i=l 


= 5 abs (AP (n+ 1) Ain( Xge — Xn(n + 1)) Bi 
+ Ri(n+ D(X. — Xi (n+ W)c7)| 
= 5 > (AP (n+ 1) Ain( Xn = X,(n+ D) Bi 


n=1 i=1 


+ Ri (n+1) Cin (X — X,(n+ 1)" Dian) 
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P 


N 
=X tr| RP (n+ y(Fi => (An X, (n+ Bi 
=l 


i n=1 


By induction and algorithm 2.1 we can obtain 


5 tr[ PT (n) (Xy — Xq(n-+1))| 


n=1 


p lR r 
a tee = ror e) 
= tr] So PF (0) Xm X,(n))| 

Laa Rut ee 
IPI? PE | a ) n( )] 
N N 
= JIRO? - X IRI? = 


Thus we have 


p 
XO tr[PP(n+1)(Xpe — X, (n+ 1)) = IR (n+1)| 


yn=1 
This implies that (2.1.7) holds for k = n+ 1. Thus, we complete the proof. O 
Lemma 2.4. P’'lLet P(m, n) € R””*™? be a square mn x mn matrix partitioned into 


m x n sub-matrices such that jith position be 1 and zeros elsewhere, t.e. 


m n 


=X X £y® Ef, (2.1.8) 


l j=l 


where Hy = ei ief 


definition, we have 


called an elementary matrix of order m x 1(n x 1). Using this 


Finite Iterative Algorithm to Coupled Transpose Matrix Equations 21 


P(m, n)vec(X") = vec(X), P(m,n)P(n,m) = Imn, 
P? (m,n) = P7!(m,n) = P(n, m). 


Lemma 2.5. P5]Suppose that the consistent system of linear equation Ax = b has a 
solution «* € R(A”), then 2* is the unique least norm solution of the system of linear 
equation. 


Theorem 2.1. Assume that the coupled Sylvester-transpose matrix equations (2.1.1) 
are consistent, then for any initial matrices (X1, X2,..., Xp), the sequences X;(k), i € 
I[1, p| given by the algorithm 2.1, convergence to their solutions with finite iterative 
steps in the absence of roundoff errors. Furthermore, if we take the initial matrices 


N 
X= X (AFE, Bp eae, Om), A= 1,2... p, (2.1.9) 
y=1 
where E£,,y=1,2,...,N, are arbitrary matrices, or especially X;(1) = 0, i= 
1,2,...,p, then the solution group (Xj,, X9.,..-, Xp), generated by algorithm 2.1, 
is the least Frobinius norm solution group of the coupled matrix equations (2.1.1). 


Proof. Firstly, in the space R7™*?! x R2XP2 x... x R™*PN | we define an inner 


product as 
N 


((A1, A2,- -n An), (Bi, Bo, ++, Bw)) = X tr(B7 A), 
i=l 
for (A, Ao, eer Ay), (Bı, Bo, any By) E RMP x SR? * Pa Xe X SRN PN 
If SIRE? #0, k= L12, g 257 mipi, then from previous lemmas we 
get So? ,||P)(k)||? #0. Now we can compute Ri(q+1) and [X,(q+1), 
Xəlq +1),..., X (q+ 1), 
From lemma 2.2, it is not difficult to get 


N 
XOR +R) = 0,5 = 1,2,...,4 


i=l 


and 


N 
SO(RT(m)RG)) =0, m, j =1,2,.. 0 M Fj. 


i=1 


Then [Ri(k), Ro(k),..., Ry(k)], k = 1,2,...,2q, is a group of orthogonal basis of 
the previously defined inner product space. It follows from [Ri(q+1), 
Ro(q+1),...,Rw(q+D] =0 that [Xi(q¢+1), Xe(q4+]),...,X,(q+)D] =0 is a 
solution group of problem 2.1. Therefore when problem 2.1 is consistent, 
we can verify that the solution group of problem 2.1 can be obtained within finite 
iterative steps. O 
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Now let E, be arbitrary matrices for y = 1,2, ..., N. We can get 


N 
vec( $ (Ap Ey, BA + Dn EP Cx) 
1 


+ Dp Er C2) 


N š 
vec( (Anp En Br + DrpEq Cw)) 


By Q AG =I (C4 ® Di) P(m, pı) 
By Q AF a (CZ ® D2) P(m1, pı) 


Bip &® Ay, + (Ci ® Dip) P(m1, pı) 


Byı ® Ay, + (CF ® Dui) P(mn, py) vec( E1) 

Byz ® Any + (CT, ® Dyz) P(mn, py) vec( E2) 
x 

Bnp & ANp +r (Cp ® Dwy)P(mn, Py) vec(Ey) 


Bh & Ayt P”(m, p )(Cu 8 Di) 
Be & Agy + P? (mp, D)(Cor 8 Dz) 


By, ® Anı + P (my, py)(Cm ® Dfa) 


By, ® Aip+ P* (mi, pi)(C ® DP) vec( E1) 

B3, ® Aap + P7 (ms, po) (Crp ® Dap) vec( E2) 
x 

By, ® Anp + P?(mw, py)(C np ® DR) vec( Ey) 


BY, ® Au + P" (mi, p1)(Cu 8 Dj) 
By, ® Ani + P* (me, pp)( C21 ® DA) 


ER 
By, 8 Anı + P* (my, pw)(Cu1 8 Din) 


T 
By, ® Aip + P? (mi, pi)(Cip 8 Diy) 


B3, & Áp + P? (m2, Po) (Crp 8 D3,) 


Bip @ Anp + P” (mn, py)(Cnp ® Dip) 
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If we consider the initial matrices 


N 
Xi(1) = X (ALE, BT + Dp B? Cri), i € [1 p], 
n=1 
where E,,y=1,2,...,N, are the arbitrary matrices, then all X;(k) for 
i= 1,2,..., p, generated by algorithm 2.1 satisfy 


BT ® Au T PT(m p \(Cu ® DŁ) 

vec(X1(k 14 oe} 4 

o By, ® An + P” (m, p)(C21 ® Dy) 
Bx @ Ani + PT (my, p )(Cu1 ® Diy) 
vec(X,(k)) N1 KEN N1 


T 
Bi, 8 Aip aR P” (mi, pi)(Caip 8 DS) 


B5, ® Aap T PT (mg, pa)( Cap 8 D3) 


Bip ® Anp + P? (my, pu)(Cnp @ Dip) 


Hence, with the initial matrix group (X1(1), X2(1),..., Xp(1)) where 


N 
Xi(1) = X (ApEn By + DyiBy Cri), i€ [1p], 
n=1 
according to lemma 2.5, the solution group (X1.(1), X9.(1),..., Xp.(1)) obtained by 
algorithm 2.1 is the least Frobenius norm solution group. 
The proof of problem 2.2 will be given as follows. 
When the matrix equations (2.1.1) are consistent, the solution set Sg of the 
coupled matrix equations (2.1.1) is non-empty. For a given matrix group 


Ri, Xo,..., Xp) with X; € RI", 7 =1,2,...,p, it is not difficult to get 
p j J g 


N 
Ao Bn t CnX Da) = Fo. i=1,2,.. N, 


y=l 


N 
= sT 
=] X Aan(X, — Xn) Bin + Cin(Xq — Xn) Din) 


y=1 
4 5 aT 
= F;— XO (AnR Ban + CX, Dig), i=1,2,.. N. 
n=1 
T 5 = A aT 
Define X,=X,—X, and Fis Fi- Soy (AX, Bin + Cin X,, Din) for 
i= 1,2,..., N. Then the matrix nearness problem 2.1 is equivalent to first finding 
the least Frobenius norm solution group (Xix, Xəx,..., Xp) of new coupled 


Sylvester-transpose matrix equations 
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N 
\ "(AX Bin + CooX, Dn) = Fi, 1=1,2,..4N, 


which can be obtained by using algorithm 2.1 with the initial matrices 


N 
X,(1) = $ (AZE, BE + Dp ET Cy), i€ [L p], 


=i 


where E, are arbitrary matrices, or especially, X;(1) = 0 for i = 1,2,..., p. Here the 
matrix solution group of the matrix nearness problem 2.2 can be represented as 


(Xi, Xə,..., Xp) with 
X = Xp +8, n=1,2,..5p. 


Thus, the proof of problem 2.2 can be finished. O 


2.2 Numerical Example 


In this section, we report a numerical example to test the proposed iterative method. 


Example 2.1. Consider the following coupled Sylvester-transpose matrix equations 


{ An XByt Cu X” Du + Ai YB + CY" Dy = Fi, (2.2.1) 
Ao XB + Ca XT Da + C2 YTD» = Eo, 
with the following parametric matrices 
-1 2 1 1 1 2 1 3 21 —2 11 1 
2 2 3 1 5 2 4 1 —2 -3 1 
m=] a 4 9 of Bu=lq 11 ipSa 13 2 ak 
1 2 5 1 2 6 2 1 11 32 5 1 
1 4 2 6 1 1 1 1 1 22 12 53 
2 2 6 1 222 4 5 2 —4 1 
An= |3 91 6)4"=]a 5 39 1fP™=]-1 1 -1 4) 
23 5 2 1 1 1 0 —2 6 2 1 
4 3 2 2 0 2 1 1 —2 2 11 3 
4 1 2 1 0 —5 3 1 —2 2 4 1 
PAR pya 4 1 S e a a7 ap ha ra N 
4 2 2 0 2 2 4 1 2 6 2 -8 
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2 1 3 1 0 2 0 1 -3 12 11 2 
43 2 6 0 11 21 1 21 23 1 2 
Be=|4 231 C2=] 4 0 2 1PP535|i 2 4ab 
1 2 30 ô =i =i i 2 11 3 2 
1889 359 1384 1269 360 656 —138 340 
p = | 543 396 513 507 | „ _ |1201 1903 671 -284 
1 344 600 671 143 |’? | 527 1539 555 1953 |” 
387 535 698 354 304 2197 474 3999 
13 2 14 61 1 12 11 13 
2 12 0 1 2 4 1 
Ce=| 3 1 2 o pPeS5| io 1 1 4 
1 2 6 1 a 6 3 T 


It can be verified that the generalized coupled matrix equations (2.2.1) are 
consistent and have a unique solution pair (X*, Y*) as follows: 


= V =e © 


1 
{1 
r= 
1 


bow bw bw 
Dow bd bw 
ANNE 
PRE NH 
Nores 


If we let the initial matrix (X(1), Y(1)) = 0, applying algorithm 2.1, we obtain 
the solutions, which are 


—1.0000 2.0000 2.0000 1.0000 
1.9999 2.0000 1.9999 1.9999 


AUDIS 2.0000 1.9999 3.0000 2.0000 }’ 
0.9999 1.9999 2.0000 4.0000 
1.0000 0.9999 0.9999 0.0000 

Y(109) = 1.0000 2.0000 0.9999 0.9999 


0.9999 1.0000 0.0000 2.0000 ļ’ 
0.9999 1.0000 2.0000 1.0000 


with corresponding residual 


|| R(109)|| = 4.2982 x 107". 


The obtained results are presented in figure 2.1.1, where 


oy — IXW), YG) = (X, Y’) 
IO 


rr = ||R(k)|]. 
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4 T T l 


109, 4% 
109% 7 


-14 f f 1 
0 20 40 60 80 100 120 
iterative number k 


Fic. 2.2.1 — The relative error of solution and the residual for example 2.1. 


Now let 
1 1 1 0 1 02 0 
5 0 0 0 1 S5 1 1 2 0 
EE 1 7 1 1 in 1 01 Of’ 
1 1 2 8 1 0 0 2 


By algorithm 2.1 for the generalized coupled Sylvester matrix equation (2.2.1), 
with the initial matrix pair (X(1), Y(1)) = 0, we have the least Frobenius norm 
solution of the generalized coupled Sylvester matrix equation (2.2.1) by the fol- 
lowing form: 


—2.0000 0.9999 1.0000 1.0000 
2.0000 1.9999 1.9999 1.0000 


K SA 0.9999 —4.9999 1.9999 1.0000 |’ 
0.0000 1.0000 0.0000 —4.0000 
0.0000 1.0000 —1.0000 0.0000 
Y = Y(107) 0.0000 0.9999 —0.9999 0.9999 


0.0000 0.9999 —0.9999 1.9999 |’ 
0.0000 0.9999 2.0000 —1.0000 


with corresponding residual 


|| R(107)|| = 7.8716 x 1071. 
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60 
iterative number k 


120 


Fic. 2.2.2 — The relative error of least Frobenius norm solution and the residual for 
example 2.1. 


The obtained results are presented in figure 2.2.2. Therefore, the solutions of the 
matrix equations nearness problem are 


—1.0000 1.9999 2.0000 1.0000 
G =s. & 2.0000 1.9999 1.9999 2.0000 
X=X +X=1 19999 20001 2.9999 2.0000 |’ 
1.0000 2.0000 2.0000 4.0000 
1.0000 1.0000 1.0000 0.0000 
~ —. a | 1.0000 1.9999 1.0001 0.9999 
Y=Y +Y=1 10000 0.9999 0.0001 1.9999 
1.0000 0.9999 2.0000 1.0000 


2.3 Control Application 


A number of control problems are related to the SCA (state covariance assignment) 
problem"), 51 for example, cone napa obserbability Gramian assignment’, vee 
certain ce of H control problems? 7l. From a mathematical viewpoint, we point 
out that both the continuous-time and discrete-time SCA problems can be reduced 
to solving a symmetric matrix equation. Let us expand the continuous-time 
Lyapunov equation 


AxX+XAi+ BrBy = 0, 
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as 
(AX + XA‘ + B, BY) + By K(C)X + Do B?) 
+ (CX + Da BT)" KTB? + ByK(Dn DE) K? BI =0. 
We also expand the discrete-time Lyapunov equation 
Ax XAj — X + BKB% =0, 
as 


(AXAT — X + B, BT) + ByK(CyXA‘ + Da BT) 
+ (CoXA™ + Da BT)? K? BE + Bo K(CoXCP + Da DE) K* BT =0. 


It is easy to see that both the continuous-time and discrete-time SCA problems 
are essentially the same from the viewpoint of mathematics. 

We also consider the relationship between the matrix equation and some 
important special cases as a control problem. For example, let matrices B € 
R”, QER™", RE RP”? and S € R?*” be given where Q = Q7, R= RT > 0 and 


rank R =r. We focus on a symmetric matrix equation of quadratic type“: 


Q+ BKS+(BKS)" + BKRKTBT = 0. (2.3.1) 


Thus, the solution of the symmetric matrix equation above is equivalent to the 
SCA problem with proper definitions of B, Q, R, and S. When R = 0, the special 
case of matrix equation above is reduced to the Karm-Yakubovich-transpose matrix 
equation X — AXTB = C. 


2.4 Conclusions 


In this chapter, we have constructed an iterative algorithm for solving the gener- 
alized coupled Sylvester-transpose matrix equations. By this algorithm, the solv- 
ability of the generalized coupled Sylvester-transpose matrix equations can be 
derived automatically. Also when the considered coupled matrix equations are 
consistent, for any initial matrix group, a generalized solution group can be obtained 
in finite iterative steps in the absence of roundoff errors. Furthermore, we have 
solved problem 2.2 using the proposed algorithm 2.1. Finally, a numerical example is 
presented to support the theoretical results of this chapter. 


Chapter 3 


Finite Iterative Algorithm to Coupled 
Operator Matrix Equations 
with Sub-Matrix Constrained 


In this chapter, we consider the following linear matrix equations 


[> A(X), » Aul X d,- >> Api(Xi)] = [Ma, Mz,- My], (3.0.1) 


where As; E€ LE™™*"?s*4% and M, € C**,i,5=1,2,...,p. This coupled operator 
matrix equations (3.0.1) include the generalized coupled Sylvester matrix equations 
and generalized coupled Lyapunov matrix equations as special cases. In addition, all 
the constraint solutions in!!™!®?°.?534 46] can be summarized as the following cases. 


(1) Symmetric (Skew-symmetric) constraint: X = X7(X = —X*); 

(2) Centrosymmetric (Centroskew symmetric) constraint: X = S X Sn (— Sn X Sn); 

(3) Reflexive (Anti-reflexive) constraint: X = PXP(— PXP); 

(4) Generalized reflexive (anti-reflexive) constraint: X = PXQ(—PXQ); 

(5) P orthogonal-symmetric (orthogonal-anti-symmetric) constraint: (PX) = 
PX(—PX), where P? = P = P £ I„ and Q? = Q= Q7! Æ In. 


It should be remarked that all the above common constraint solutions of matrix 
equations are all special cases of the following constraint 


X=U(X), (3.0.2) 


where U € LC”*" is a self-conjugate involution operator, i.e., U* =U,U? =T. 

From an operator point of view, in this chapter we construct a finite iterative 
algorithm to solve the coupled operator matrix equations (3.0.1) by extending the 
idea of conjugate gradient method. On the whole, we mainly consider the following 
two problems. 


DOI: 10.1051/978-2-7598-3102-9.c003 
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Problem 3.1. Let S denote the set of constrained matrices defined by (3.0.2). For 
given Aij E LO™I* HPX 4i, M; € QPAR, te 9 = L2 ep find Xj E S, j = 12a P 
such that 


Pp Pp p 
p3 Anl Xi), X Aul X:), -X Api(X)] = (Mi, Ma, ..- My). (3.0.3) 
i=1 i=1 


i=1 


Problem 3.2. Let S denote the solution set of problem 3.1, for given 
Xe", 7 =1,2,...,p, find X; € $,j = 1,2,...,p, such that 


SE- X= win, fY here ‘| (3.0.4) 


In the following, we define inner product as (X,Y) = tr(Y"X) for all 
X, Y € C™". If (X, Y) =0, two matrices X and Y are said to be orthogonal. In 
addition, let LC”™*"?*? denote the set of linear operators from €"*" onto €?*!, 
Specially, when p=m and q=n, 2C"*"?*" is denoted by 2C”*". For 
Ae QC”X™PXI its conjugate operator A* is a linear operator satisfying the fol- 
lowing equality 


(A(X), Y) =(X,A"(Y)), for all X € O"™", Ye or! 


For example, if A is defined as X —> AXB, then we have A* : Y > A” YB", 


3.1 Iterative Method for Solving Problem 3.1 


In this section, first of all, in order to solve problem 3.1, we propose an iterative 
algorithm. Next, some basic properties of the algorithm are presented. Finally, 
finding the least Frobenius norm solution to problem 3.1 is considered. In the sequel, 
the least norm solution always means the least Frobenius norm solution. 


Algorithm 3.1 
Step 1. Input Aj E€ QO PME M; e*t, and an arbitrary X;(1) €S, 
4,9=1,2,...,D; 


Step 2. Compute 


R(1) = ding (Ma — Y Au (XC), Ma — X AXC), -+ Mp = X3 A(X) 
= =e Fal ), Ra(1). --» Rp(1)); 
Pi) = EAR .(1)) +UA*(R,(1))], i = 1,2,..., p; k := 0; 


=l 
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Step 3. If R(k) = 0 then stop and (X1 (k), X2(k), . . -, Xp(k)) is the constraint solution 


group; 
else if R(k) # 0 but Pm(k) = 0 for all m = 1,2, ..., p, then stop and the general 
coupled matrix equations (3.0.1) are not consistent over constraint solution group; 


else k := k+ 1; 


Step 4. Compute 


2 
IRE- Die 5 Pi(k 1), 
i=1 ll Pe(& — 1)|Ip 


R(k) = diag( M, = Dd Au(Xi(h)), Mə — 2, Aoi(Xi(k)), -- Mp — 5 Ap (X:(k))) 


Xi(k) = Xı(k — 1) + 


aia ig Lg taal Arce 9) 
So An (Pik tee i(k — 1))) 
coe RK) Ry) 

Zi( =M; k)) +UA% (R:(k))]; 


Ec k i 


Pi(k) = Zi(k) + 


= FDO RC)) HUASCO) 


S: 


2 
|R(k — 1)||7 
Step 5. Go to step 3. 


Some basic properties of algorithm 3.1 are listed in the following lemmas. 


Lemma 3.1. The sequences {X;(k)} and {Pi(k)},i=1,2,...,p, generated by 
algorithm 3.1 are contained in the constraint set S. 


Proof. We prove the conclusion by induction. For k = 1,i=1,2,...,p, by U? = T 
and algorithm 3.1, we have 
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For k = 2, since X;(1) € S,i = 1,2,..., p, by algorithm 3.1, we have 


IROI” 
U(X:(2)) =U(X;(1 O i 
(Xi(2)) = U(X:(1)) + r IPD (1)) 


IRO) 
= X;(1)4 P;(1) = X,(2), 
+ Fe pape OTA 


i.e., X;(2) €S,i=1,2,...,p. 
Moreover, we have 


U(P,(2)) = U (ZDAR) +UA; CR2))] + kar 
s=1 T 
= u(S> As (R(2)) +UA% (R.(2))] + IROI yep) 


=1 l RO) Il 
| 


= tuae) + Ar) + EOE pa) 


r= a RO) Il 


i.e., Pi(2) € S,i= 1,2,..., p. 
Now if we assume that the conclusion holds for k= m(m> 2), ie. 
X;(m), Pi(m) € S,i = 1,2,..., p, then we can obtain 


U(Xi(m+1)) 


|| R(m) |e 
=U(X;(m)) 4 = U(Pi(m 
wn Xia Pim) lp ea 


1R(m) Il? 
= Xm) 4 ale _ pny = Xm 40), 
Te eae A 


and 
U(P;(m+1)) 
=u} 59 (Aalto 1) FUAR (m 1) LERE DNE a Py 
= WA, (R.(m+1)) + At( miny 4 1ROm+ De pem) 


si Ry 2 
s=1 | R(m) |p 
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Therefore, we can get 
Xi(m+ 1), Pi(m+ 1) E S, q= 1,2, =... p. 
Thus, by the principle of induction we draw the conclusion. O 
Lemma 3.2. Supposed that X* = [Xj], X3,..., Xj] is a solution of problem 3.1. Let 


X(k) = [X1(k), Xo(k),..., Xp(k)], then the sequences {X;(k)}, {R(k)} and {P(k)} 
generated by algorithm 3.1 satisfy the following equality 


(Xt — Xi(k), P(E) = |R, i=1,2,..,p. &=1,2,... (3.1.1) 


Me 


2: 


ll 
fan 


Proof. We prove the conclusion by induction. For k = 1, it follows from X7, X;(1) € 
S that Xš — X,(1) € S. Then by algorithm 3.1, we have 


=F Aa AF — XD) +AU — (1), BD) 


= SRD, RD) = DY ROI? = IROI. 
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For k = 2, by algorithm 3.1 and lemma 3.1, we have 
p 


yA; (Rs(2)) +UA (R(2))]) 
k BOE x; P;(1)) 
ae 
= $ O = X18), AL (RA(2)) +UA; (RA) 
IRD (ye -ROI py) pa 
* Rey pay yr PDI (0), P.Q)) 
1 P Pp 
=A A 


IRQ Sir 
pE & EO 


=r (Xj — X;(2)), Rs(2)) 
=J (M, - YAX), RD) 


= DIRON = IROI 


Assumed that the conclusion holds for k = 
im 


= m(m> 2), ie. IL, (Xt — Xi(m), 
P;(m)) = ||R(m)|?, so for k = m+ 1, we have 
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DMX i(m+1), Pi(m+1)) 


7” - X; (m+, [AR R,(m+1)) 


s=1 


(R(m+1))| 4 [Rm + DMF p (ny) 


i [RI 
= (X; -Xi(m+ D5 DMR (m+ 1))+u 
x A; (R(m+1))]) Ue le yxy x (m+ 1), Pi(m)) 


-3X D0- Xi(m+1), A% (R(m+1)) +UA; (R(m+ 1))) 


IRD Cp yen iaie ry pin 
+ Tale oy EE) Sa agen Pad) 
=3) 5 0- Xi(m+ 1), Ay (ROY) +UA (ROY) 

|| R( Ta [R(m+ Dey Path 

[Romy i(m)) 

io i (Pilon), Pil) 


Dia Ple E 


5 DIT — X;(m+1)), R(m+ 1)) 
= 3 (m, -J Aal(Xi(m+1)), Rom 1)) 


= ÑU R(m+ DI = Rm +1). 


Thus, we complete the proof by the principle of induction. 
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Remark 1. From lemma 3.2, we can conclude that ||R(k)||? 40 implies that 
5} Pi(k) Æ 0 if problem 3.1 is consistent. Else if there exists a positive number m 
such that || R(m)||? 4 0 but $2; Pi(m) = 0, then problem 3.1 must be inconsistent. 
Hence, the solvability of problem 3.1 can be determined by algorithm 3.1 in the 


absence of roundoff errors. 


Lemma 3.3. For the sequences {Ri(k)}, {Pi(k)} and {Z;(k)}, i= 1,2,...,p, gener- 


ated by algorithm 3.1, satisfy the following equality 
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X (Ram +1), Ri(n)) = Y (Rim), Rila) — yb 9 (Pi(m), Zil). 


(3.1.2) 


Proof. According to algorithm 3.1, lemma 3.1 and the relation U* = U, we have 


> (Ri(m +1), Ri(n)) 
es RCO Eg carton mit 
DRC) — SF Paap Bp PH) Fal) 
= S(R,(m), Bi(n)) was oT NO So (Ai(Pi(m)), Bin) 
i= t=1 tM) ||P i=1 t=1 
= (Ril), Ry(n)) - EIE S (Pm), ARa) 
i= t=1 Pi(m)||p i=1 t=1 
= (Ri(m), Ri(n)) 
LIRR BY ne 
DSP, [Pap Sot 2 EO tM Pale), Ai al) 
= S°(Ri(m), Ri(n)) — A Se: 
i=l Di || Pimp t=1 
5 il Ri(n)) +UA; CRC) 
= XO (Rim), Rm) a r Yo (Pam), Zi) 
p Rm g 
= Ri(m), Ri - 5 Pi(m), Zi(n 
2 alm), Bal) -a T pa ge A 
This completes the proof. O 


Lemma 3.4. Supposed that problem 3.1 is consistent. If there exists a positive 
integer m such that ||R(m)||? 40 for all m=1,2,...,k, then the sequences 
{Xi(m)},{Ri(m)} and {Pi(m)} generated by algorithm 3.1 satisfy the following 
relations 


P 


D (R:(m), Ri(n)) = 0, and X- (P:(m), P:(n)) = 0, (3.1.3) 


i=l 


in which m,n = 1,2,... k, m Æ n. 


Proof. For arbitrary two matrices A and B, by using the property of inner product 
we have (A, B) = (B, A). Thus, we only need to prove the conclusion holds for all 
O0<n<mK< k. In the case of n = 1, by lemma 3.3 we have 
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p IROI g 
= X (8.0), R0) PZ 
DRD RD — Spray PP, 2D) 
-Yr -ELE Sea), pay =0 
=a rc a= ae l 
and 
3 (Pi), Pi) 
=F (FEM) UAH) + E a P,(1), PAD) 
= 5 (R), AS Aa (PD) HUASPA) + ar (1), PD) 
=5 (A - SAD a (D), Aut Pad) 
any ROI 
+UAa(Pi(L))) + R ae Oly 
= 5D (ml (1), An(Pi(1)) +UAa(P.(1))) 
1 R(1 
= PAA Oy? i(1)), Asi(Pi(1)) 
any ROIR 
+UAW(PiD)) + Oe ae DI 
= $ (RD, Aa PACD)) + OFA (IP 
RO p p 
j SP oy PAD Aa? ay) 
: SP IPODI 
Et n Loe | Hs NIP — 
RO PP, ||P 
LTPP S| op OS 
SG ol? 
op CO ii aop ae 
= EOIS (x, R=) KALS r, o 
t=1 Pi( 1 
-MR ES (Rt (2), Bu) ~ RaQ) 


D PI? 2 a IROI? 
= Pi 1 ae 2 R 1 R(2 2 Pi 1 =0. 
B ol mor CROP + IRON EE 3 PIP 
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Now if we assume that }>?_,(Ri(m), Ri(n)) = 0 and X$ (Pi(m), Pi(n)) = 0 hold 
for all0<n<m,0<m<k, next we will prove that $>?_,(Ri(m+ 1), Ri(n)) = 0 and 
5 (Pi(m+1), Pi(n))=0 hold for all 0<n<m+1,0<m+4+1<k. By the 
hypothesis and lemma 3.3, in the case of 0< n< m, we can obtain 


P 


SO (Ri(m+1), Ri(n)) 


i=l 


= Y (Alm), Ri) — OM (Piem), Zi) 


= P PI 
-z PAPA (oro ene" D) 
p a 23 (Pm) Pi(n)) 


and 


=Y (Zim je Ee P;(m), Pi(n)) 


ci || R(m) | 
= : (m+ (n R(m+ YIP 3 i(m), Pi(n 
= (Ail 1), P(n) + ea (PA ), Pi(n)) 
= XO (Zi(m+1), Pi(n)) 
Dia (Riln+ 1), Ri(n)) — De (Ri(m+ 1), Ri(n+1)) _ n 
R(m 
= 1 oy, 
In the case of n = m, we also have 
So (Ri(m+ 1), Ri(m)) 
p | R(m P 
= Ri m Ri m p 
dA (m), Ri(m)) Decal 2 Aes 
2 2 |R(m)|? ot IRn)? 
= Ri(m 7 Pi(m Pi( 5 Pi m—1 
2! ay tai lP) 22 (PA | R(m — 1)| ) 
2 || R(m)|? | R(m 
= ||R(m)||" — || Rom { i(m— 1 
IRI? = IROI a Pj [Ria oP fe m—1)) 


= 0, 
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and 


; || R(m+ III 
= Zi(m4 | 3 Pi(m), Pi(m 
DAB NTT tem PP i 


IRC mle 


DS Pim)? 
IR(m+ IF o li 
Hena Ali 
|| R(m Pdr 


Therefore, by the principle of induction, the proof has been completed. O 


Remark 2. Lemma 3.4 implies that when problem 3.1 is consistent, the sequences 
P;(1), Pi(2),..., i= 1,2,...,p, are orthogonal to each other in the finite dimension 
matrix space S. Hence, there exists a positive integer t<mn_ such 
that P;(t) = 0,i=1,2,..., p. According to lemma 3.2, we havel| R(#)||? = 0. Thus, it 
can be concluded that the iteration will be terminated in finite steps in the absence 
of roundoff errors. 

In the following, we will solve the least norm solution of problem 3.1. The fol- 
lowing lemmas are needed for our derivation. 


Lemma 3.5. ?5]Supposed that the consistent system of linear equations Ax = b has a 
solution «* € R(A”), then 2* is the unique least norm solution of the system of linear 
equations. 


Lemma 3.6. For A € LC”*"?**, there exists a unique matrix M € ©?" such 
that vec (A(X)) = Mvec(X) for all X € €"*". 

According to lemma 3.6 and the definition of the conjugate operator, one can 
easily obtain the following corollary. 


Corollary 3.1. Let A and M be the same as those in lemma 3.4, and A* be the 
conjugate operator of A, then vec (A*(Y)) = M“vec(Y) for all Y € ©”! 


Theorem 3.1. When problem 3.1 is consistent, if the initial matrices are chosen as 
Xj(1) =b MAH) +UA CH; j= 1,2,.-.,p, in which H; is an arbitrary 
matrix, or more especially X,(1) =0,j=1,2,...,p, then the solution group 
Xi, X5,.--,X;] generated by algorithm 3.1 is the least Frobenius norm constraint 
solution group of the coupled operator matrix equations (3.0.1). 
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Proof. Now we consider the following coupled operator matrix equations 


p 
> AnlX:) = Fi, 


i=1 


m (3.1.4) 


E Ap (U(X,)) = Ep 


If problem 3.1 has a solution [X1, Xo,...,X>], then [X1, X2,...,X,] must be a 
solution of the coupled operator matrix equations (3.1.4). Conversely, if the coupled 


operator matrix equations (3.1.4) have a solution [X),X»,...,X,], let 


X, =A) j= 1,2,...,p, then it is easy to verify that [Ry Any Xp] is a 


solution to problem 3.1. Therefore, the solvability of problem 3.1 is equivalent to the 
coupled operator matrix equations (3.1.4). 

If we choose the initial matrix X;(1) = 37? [Aj,(Hj) +UA;,(Hy)],5 = 1,2,- P, 
where H; is an arbitrary matrix in C™*™ , by algorithm 3.1 and remark 2, we can get 
the solution [X},X5,..., Xl of problem 3.1 within finite iteration steps. The 
obtained solution can be stated as X; = i)i [A}(Y 3) +UARCY hJ = 1,2, p- 
Since the solution set of problem 3.1 is a subset of that of the coupled operator 
matrix equations (3.1.4), next we will prove that [X}, X3,..., X5] is the least norm 


constraint solutions group of the coupled matrix equations (3.1.4). It implies that 
[X}, X5,---,X;] is also the least norm constraint solutions group of problem 3.1. 
Let M, and N be the matrices such that 


i vec( X71) 
vee( X A(X) = M, : i 
= vec( Xp) 
and 
vec(U(X1ı)) vec( X1) 
: =N : ; 
vec(U(X>)) TER 


for all X; € C™*™ j= 1,2,...,p. Then the coupled matrix equations (3.1.4) are 
equivalent to the following coupled matrix equations 
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M, vec( £1) 
Mə vec( E2) 
vec( X1) : 
M, f _ | vec(Ep) 
Mı N : ~ | vec(Æ) 
MN vec( Xp) vec( E2) 
M,N vec( Ep) 
Note that 
vec( Xï) vec( Yı) vec( Yı) 
ie H H yH 
= 22. M, Í +N M; 
vec( X5) a vec( Yp) vec(Y,) 
€ R(MY, MY ,..., M#,(M.N)",(M2N)",...,(M,N)"). 
Then it follows from lemma 3.5 that [X7,...,X}] is the least norm constraint 


solutions group of the coupled operator matrix equations (3.1.4). This solution is 
also the least norm constraint solutions of problem 3.1. 


3.2 Iterative Method for Solving Problem 3.2 


In this section, we consider iterative method for solving nearness problem 3.2 of 
solution to the matrix equations. Let S denote the solution set of problem 3.1. 
For given matrix Le ee" 7=1,2,...,p, and arbitrary matrix X;€ S, 
j=1,2,...,p, we have 


[o-a = Sg pay 
2 2 
= A 2 =~ a 2 
= |x; | {S| (3.2.1) 
mabe - 


Note that 


4 2 i 2 

X;+U(X;) X; -U(X;) 
= (UX; 3G 2) 
(x kit U(X) UR) - X; 
A 2 , 2 

i+ 
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This implies (x; ž; TUD) i away = 0. Therefore, the relation (3.2.1) can 
be reduced into 


A 


A 2 A A 2 
A) | +| 2 


ad 
lx- Ky" = |X 


2 2 
Hence, miny,es||X; — £;| is equivalent to min x,es|| Xj — =) , where 
ee Zula) ES. 
Now if we denote X, = X; - 40) and E,=E,— -5 As (2), 
s=1,2,...,p, then eer ae X; is the constraint solutions group of the coupled 


operator matrix equations 


[Z Au ) Yo Aa. AnD] = [Ba Bay. By) Kies, 


i=1 


for i= 1,2,...,p. Thus, problem 3.2 is equivalent to finding the least norm solutions 
of above coupled operator matrix equations. 
Based on the analysis above, it can be summarized that once the unique least 


~* =g 
norm solutions [X,,...,X,] of above coupled operator matrix equations are 


pl 
p 
obtained by applying algorithm 3.1, the unique s solutions [X1, .. ., Xp] of problem 3.2 


can also be obtained, where X; = Xx; + Xu) = L2 esp: 


3.3 Numerical Example 


In this section, we will give three numerical examples to illustrate the efficiency of 
algorithm 3.1. All the tests are performed by MATLAB 7.0 with machine precision 
around 107°. 


Example 3.1. Find the least norm symmetric solution of the following matrix 
equations 
{ Ay X1 By + AiX2Biy = Mı, (3.3.1) 


Ag, X1 B21 + Avo X2 Bor = Ma, 


where A =rand(5,5), By, =rand(5,5), Ay =rand(5,5), By. = rand(5, 5), 
Ag, = rand(5, 5), Boy = rand(5, 5), Ag = rand(5, 5), Boo = rand(5, 5). 
If we choose X = rand(5,5), Y = randi((1, 4], [5,5]), then we have 
X, = tril(X, —1) + triu(X7,0), Xə = tril(Y,—1)+ triu(Y”,0), 
Mı = Ay X1 But AiX2Bi2, Mə = An X1 Boi + Ar. X2 Bo. 


It can be verified that the generalized coupled matrix equation (3.3.1) are con- 
sistent and have unique symmetric solution pair (X1, X2). In fact, this solution pair 
is also the unique minimal norm least squares solution of matrix equation (3.3.1). 
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If we let the initial matrix X1 = (X1(1), X2(1)) = (zeros(5, 5), zeros(5,5)), X1 = 
(X1(1), X2(1)) = (ones(5,5), ones(5,5)) and X1 = (X,(1), X9(1)) = Us, I5), by 
applying of algorithm 3.1 we can obtain the symmetric solutions. r(k) and e(k) can 
be found in figures 3.3.1 and 3.3.2, where 


(Xz, Xl l 


r(k) 


—— X1=eye(5,5) \ 
—#— X1=ones(5,5) \ 
-12 f — — X1=zeros(5,5) \ | 
Ti 
=T RS J 
-16 f f i f f 1 
0 10 20 30 40 50 60 70 
iteration number k 
Fic. 3.3.1 — The residual for example 3.1. 
0 T 


-5 4 
€ 
5 
D 
-10 —*- X1=zeros(5,5) | 
—+— X1=eye(5,5) 
—*— X1=ones(5,5) 
-15 fl 1 1 f 


0 10 20 30 40 50 60 70 
iteration number k 


Fic. 3.3.2 — The relative error of solution for example 3.1. 
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Now if we let Yı = rand(5,5), Yə = randi([2, 3], [5,5]), then we have 
X, =tril(Y,,-1)+triu(Y7,0), R = tril(Y2,—1) + trin( YZ, 0). 


With the initial matrix pair X1 = (Xj(1), X2(1)) = (zeros(5, 5), zeros(5,5)), 
X1 = (X1(1), X2(1)) = (ones(5, 5), ones(5,5)) and X1 = (X,(1), X: 2(1)) = (15, I5), 
by algorithm 3.1 we have the least Frobenius norm solutions (X1 , X» ) of the 
generalized coupled Sylvester matrix equations (3.3.1). The obtained results are 
presented in figures 3.3.3 and 3.3.4. Therefore, the solutions of the coupled matrix 
equation (3.3.1) nearness problem are 


Xı =X +1, 


and 


Xp = Xa" + Xp, 


Remark 3. From figures 3.3.1 and 3.3.2, we can see that the residual and the relative 
error of the solutions to coupled matrix equations (3.3.1) are reduced with the 
addition of iterative numbers for the different initial matrices X1 = (X,(1), 
X2(1)) = (zeros(5, 5), zeros(5,5)), X1 = (X (1), X2(1)) = (ones(5,5), ones(5, 5)) 
and X1 = (X1 (1), X2(1)) = Us, Is), respectively. It showed that the iterative solution 
smoothly converges to the exact solution. Also, it is showed the presented algorithm in 
this chapter can be converged for any initial matrices with random coefficient matri- 
ces. It is proved that our proposed iterative algorithm is efficient and is a good 
algorithm. 


r(k) 


-> X1=zeros(5,5) 
-10 Ł —*— X1=ones(5,5) 
—*— X1=eye(5,5) 


0 10 20 30 40 50 60 70 
iteration number k 


Fic. 3.3.3 — The residual of least norm solution for example 3.1. 


Finite Iterative Algorithm to Coupled Operator Matrix Equations 45 


error(k) 


-142 L —&— X1=zeros(5,5) 
—+— X1=ones(5,5) 
—*-— X1=eye(5,5) 


0 10 20 30 40 50 60 70 
iteration number k 


Fic. 3.3.4 — The relative error of least norm solution for example 3.1. 


Remark 4. From figures 3.3.3 and 3.3.4, it is shown that the least norm solutions 
can be derived by using algorithm 3.1 for giving any initial matrices. Hence, if a 
group of matrices is given, we can obtain the optimal approximation solutions. 
Therefore, the presented algorithm can solve the nearness problem of coupled matrix 
equations with random coefficient matrices. 


Example 3.2. Find the least norm symmetric solution of the following matrix 
equations 
{ An Xi But CuX? Dy + ApX2By+ CXT Dip = Mi, 


3.3.2 
An X1 Boy + Ca X$ Du + Cx XE, Də = Mo, ( ) 


where A, = tril(rand(40,40),1), Cy; = rand(40, 40), Bıı = rand(40, 40), Dy, = 
rand (40, 40), Aj = rand(40, 40), Cio = rand(40, 40), By = rand (40, 40), Di2 = 
rand (40,40), A = diag(1+diag(rand(40))), C2, = diag(0.5 + diag(rand(40))), 
Boy = rand(40, 40), Də = rand(40, 40), Co = rand(40, 40), Də = rand(40, 40). 

If we choose X = randi((1, 3], [40, 40]), Y = randi([2, 4], [40, 40]), 


X, = tril(X,—1) + triu(XT, 0), Xə = tril(Y,—1)+ triu(Y7,0), 


then we have 
Mı = Anı Xı Bı + CuX) Diu + Ay, X2 B12 + Ci2X7 Dy, 
Mə = An Xı Ba + Ca X$ Da + Ca X4 Do. 


It can be verified that the generalized coupled matrix equations (3.3.2) are 
consistent and have unique symmetric solution pair (X1, X2). Meanwhile, this 
solution pair is also the unique minimal norm least squares solutions of matrix 
equations (3.3.2). 

If we let the initial matrix X1 = (X1 (1), X2(1)) = (a, I40), by applying of 
algorithm 3.1, we can obtain the solutions. r(k) and e(k) can be found in 
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figure 3.3.5. Moreover, if we let the initial matrix X1 = (X,(1), X2(1)) = 
(2+0.1 x ones(40, 40), 2+0.1 x ones(40,40)), by applying of algorithm 3.1, we 
can also obtain the solutions. r(k) and e(k) can be found in figure 3.3.6, where 


WX), X2(k) = (Xi, X)| 


rr = || RCK). 


II(X7, X3) 


-14 1 1 f f f f 1 1 1 
0 100 200 300 400 500 600 700 800 900 1000 


iteration number k 


Fic. 3.3.5 — r(k) and e(k) for example 3.2: (X1(1), X2(1)) = (Lao, 40). 


—— log o'k 


log 40€% 
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iteration number k 


Fic. 3.3.6 — r(k) and e(k) for example 3.2: (X1(1),X2(1)) = (2+0.1 x ones(40, 40), 
2+ 0.1 x ones(40, 40)). 
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Now if we let Yı = randi((0, 1], [40, 40]), Y2 = randi([2, 3], [40, 40]), then we have 
Za =tril(Y1,-1)+triu(Y7,0), X22 = tril(Y2,—1) + triu( Y 7,0). 


With the initial matrix pair X1 = (X1 (1), X2(1)) = (ones(40, 40), ones(40, 40)), 
by algorithm 3.1 we have the least Frobenius norm solutions (X1 , X3) of the 
generalized coupled Sylvester matrix equation (3.3.2). The obtained results are 
presented in figure 3.3.7. 

Moreover, now if we let Yı = randi([0, 1], [40, 40]), Y2 = randi((0, 1], [40, 40]), 
then we have 


Žu = tril(Y1,—1) + triu(Y 7,0), Xo) = tril(Y2, —1) + triu(Y 7,0). 


with the initial matrix pair X1 = (X1(1), X2(1)) = (Iso, I40), we have the least 
Frobenius norm solutions (X; , Xz ) of the generalized coupled Sylvester matrix 
equation (3.3.2). The obtained results are presented in figure 3.3.8. Therefore, the 
solutions of the coupled matrix equation (3.3.2) nearness problem are 


Xı =X +1, 


and 


X= X; + Xo. 


Remark 5. If we provide a group of random coefficient matrices with a bigger 
dimension, figures 3.3.5 and 3.3.6 show that the presented algorithm is still con- 
vergent for any initial matrices. Figures 3.3.7 and 3.3.8 prove that the least norm 


-14 1 1 L 1 § 1 1 1 1 
0 100 200 300 400 500 600 700 800 900 1000 


iteration number k 


Fic. 3.3.7 — r(k) and e(k) of least Frobenius norm solutions for example 3.2: 
(X1(1), X2(1)) = (ones(40, 40), ones(40, 40)). 
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-14 1 i i f f f 1 1 1 
0 100 200 300 400 500 600 700 800 900 1000 


iteration number k 


Fic. 3.3.8 — r(k) and e(k) of least Frobenius norm solutions for example 3.2: 
(X1(1), X2(1)) = (Lao, T40). 


solutions can be obtained by using algorithm 3.1 for higher dimension random 
coefficient matrices. Hence, if a group of higher-dimension matrices are given, the 
optimal approximation solutions can be derived. Therefore, the presented algorithm 
can solve the nearness problem of coupled matrix equations with higher-dimension 
random coefficient matrices. This further proves the effectiveness of our proposed 
iterative algorithm. 


Example 3.3. Consider the centrosymmetric solutions of coupled 
Sylvester-transpose matrix equations 


{ An XByt Cu X” Du + Ai YB + CY" Dy = Fi, (3.3.3) 


Ao XBo + Ca XT Da + C2 Y" Dog = Eo, 


with the following parametric matrices 


-3 12 11 2 2 179 —27 58 97 60 
2 3 1 2 3 112 177 43 —46 164 
Dy= |i 2 1 5|,A=] 63 41 51 269 200 |, 
1 3 2 5 -12 48 2 176 136 
-1 -2 11 4 158 94 84 53 75 
147 366 332 262 331 -2 1 3 1 -1 
988 212 272 505 587 4 3 2 -1 4 
E,= | 388 233 198 149 200],Bo=| 4 32 1 4 |, 
88 65 -57 -17 —4 123 0 5 
198 109 139 143 179 230 3 4 
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1 -2 1 -1 1 1 2 -3 3 
2 —2 3 =i 0 5 -2 4 1 0 
An=]2 1 -2 2 -3|,Bu=|1 -1 4 0 |, 
1 2 1 1 2 6 -2 1 1 
1 2 2 3 2 1 3 4 3g 
1 -2 12 3 0 02 0 1 4 
p Ari 0 11 2 ë 1 5 
Dy=|1 1 -1 4 3|,C2=ļ|4 0 2 1 5), 
-2 6 2 13 0 -1 -1 1 -3 
1 2 -102 i 2 3 -1 2 
0 5 1-1 0 3) B® <1] 33 
0 -5 3 1 0 =: 2 —4 1 3 
Ci=]6 1 7 2 3 |,Du=| 1 1 0 0 4), 
2 2 4 1 3 2 -6 2 8 -l 
3 -2 2 1 —4 -2 -1 —2 3 4 
3 2 4 11 t 12: =f =3 i 
2 2 1 0 > 2 4 1 1 
C= | -2 1 0 0f,Də=|10 1 1 4 2], 
1 2 -6 i 1 -2 -6 2 1 2 
1 2 -1 —2 3 i 2 0 <4 0 
a an ey ae 1. 2 1 10 
4 1 2 -1 4 2 —2 -3 10 
Ba=]|2 3 3 1 2 |,Ca=|2 -3 2 2 1l, 
42 2 0 0 11 -12 5 1 1 
2 2 2 1 1 i 2 2 14 
1 -4 2 -6 0 id =i- ï =i 
2 2 6 1 0 22 2 4 2 
Ag=|2 2 1 6 1 |, Ay=|15 3 1 3 
2 3 5 2 —4 tt 1 0 1 
2 3 0 1 2 00 0 1 1 


It can be verified that the generalized coupled matrix equations (3.3.3) are 
consistent over-generalized centrosymmetric matrices and have the generalized 
centrosymmetric solution pair (X*, Y*) with 
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1 1 02 1 
1 —1 0 2 1 
X*=|0 0 1 0 0] € CSRZ, 
2 2 00 1 
1 1 0 1 1 
1 0 020 
0 —1 2 0 1 
Y*=|0 2 1 0 1] € CSRE, 
2 0 0 0 0 
0O 1 101 
where 
10 0 00 
01 0 00 
Q,=|0 0 -1 0 0| €soOR™, 
00 0 10 
00 0 01 
1 0 0 0 0 
0—1 0 0 0 
Q,=|0 0 —1 0 0 | €sOR* 
0 0 0 1 0 
0 0 0 0 -1 


Taking the initial matrices (X(1), Y(1)) = (ones(5, 5), ones(5,5)) and applying 
algorithm 3.1, we obtain the solutions 


1.0000 1.0000 0.0000 1.9999 1.0000 
1.0000 —0.9999 0.0000 1.9999 0.9999 
X(50) = | 0.0000 0.0000 0.9999 0.0000 0.0000 |, 
1.9999 1.9999 0.0000 0.0000 0.9999 
1.0000 0.9999 0.0000 0.9999 0.9999 
1.0000 0.0000 0.0000 2.0000 0.0000 
0.0000 —0.9999 1.9999 0.0000 1.0000 
Y(50) = | 0.0000 1.9999 1.0000 0.0000 0.9999 
2.0000 0.0000 0.0000 0.0000 0.0000 
0.0000 1.0000 0.9999 0.0000 0.9999 


with corresponding residual 
|| R(50)|| = 9.1981 x 107”. 


The obtained results are presented in figure 3.3.9, where 


—_ \I(X(k), ¥(k) — (X*, Y*) 
E 


r: = ||R(k)||. 
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iteration number k 


Fic. 3.3.9 — The relative error of solution and the residual for example 3.4. 


Now let 
2 2 022 2002 0 
2 2 022 02 202 
X={!0 020 0],¥Y=|0 2 20 2 
2 2 02 2 2002 0 
2 2 022 02 202 


Choosing the initial generalized centrosymmetric matrix pair (X(1), Y(1)) = 
(ones(5, 5), ones(5,5)), by algorithm 3.1 we have the least Frobenius norm 
generalized centrosymmetric solutions of the generalized coupled Sylvester matrix 
equations (3.3.3) with the following form 


—1.0000 —0.9999 0.0000 0.0000 —1.0000 
—0.9999 —2.9999 0.0000 0.0000 —1.0000 
X“ = X(50)= | 0.0000 0.0000 —1.0000 0.0000 0.0000 |, 
0.0000 0.0000 0.0000 —1.9999 —1.0000 
—1.0000 —1.0000 0.0000 —1.0000 —1.0000 
—0.9999 0.0000 0.0000 0.0000 0.0000 
0.0000 —2.9999 0.0000 0.0000 —0.9999 
Y'= Y(50)| 0.0000 0.0000 —0.9999 0.0000 —1.0000 |, 
0.0000 0.0000 0.0000 —1.9999 0.0000 
0.0000 —0.9999 —1.0000 0.0000 —0.9999 
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with corresponding residual 
|| R(50)|| = 5.1001 x 107”. 


The obtained results are presented in figure 3.3.10. Therefore, the solutions of the 
coupled Sylvester-transpose matrix equations nearness problem are 


1.0000 1.0001 0.0000 2.0000 1.0000 
7 p 1.0001 —0.9999 0.0000 2.0000 1.0001 
X =X +8 = | 0.0000 0.0000 1.0000 0.0000 0.0000 
2.0000 2.0000 0.0000 0.0001 1.0000 
1.0000 1.0000 0.0000 1.0000 1.0000 


and 


1.0001 0.0000 0.0000 2.0000 0.0000 

Ji 0.0000 —0.9999 2.0000 0.0000 1.0001 

Y = Y + Y = | 0.0000 2.0000 1.0001 0.0000 1.0000 
2.0000 0.0000 0.0000 0.0001 0.0000 

0.0000 1.0001 1.0000 0.0000 1.0001 


Remark 6. From figures 3.3.1-3.3.10, it can be concluded that the presented 
algorithm 3.1 can solve many kinds of constrained solutions such as the symmetric 
solution, centrosymmetric solution, and reflective solution. Also, it is showed 
algorithm 3.1 can computer solutions and least norm solutions of coupled matrix 


0 5 10 15 20 25 30 35 40 45 50 
iteration number k 


Fic. 3.3.10 — The relative error of the least Frobenius norm generalized centro-symmetric 
solution and the residual for example 3.4. 
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equations with some random coefficient matrices, higher dimension random 
coefficient matrices, and real coefficient matrices for details. Therefore, it can solve 
the nearness problem of coupled matrix equations, including coupled transpose 
matrix equations, general coupled matrix equations, and general matrix equations 
with X and Y unknown. This further proves the effectiveness of our proposed 
iterative algorithm. 


3.4 Control Application 


Example 3.4. Consider a linear system which can be described as: 


r= Ar+ Bust Pu, 
w= Fu, 
e= Cr+ Qu, 


where AER", BER" FER’? PERV! C e R”™™ and QER” are 
constant matrices, x € R”, u € R” and e € R” are the state, the control input and 
the measurable error output, respectively. The symbol w € R?” is the exogenous 
input which includes “reference signals to be tracked” and/or “disturbances to be 
rejected”. 

If we assume that (A, B) is controllable, then F is critical stable. If the full 
information feedback u = — Kz + Lw is applied on the system, then the closed-loop 
system can result in: 


t= (A -— BK)r+ (P + BL)u, 
w= Fu, 
e= Cr+ Qu, 


The aim of the output regulation problem is to find two matrices K and L such 
that the matrix A — BK is stable and 


lim; elt) = limy..(Cx(t) + Qu(t)) = 0, 


which (2(0), w(0)) are arbitrary and (x(0), w(0)) € R” x R”. It has been shown in?” 
that such a problem is solvable if and only if there exist two matrices X and Y such 
that 


AX — XF = BY +R, 


CX+Q=0. 


By the theorem 3.1, we can obtain the solution to the matrix equation above. 
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3.5 Conclusions 


In this chapter, in order to solve all kinds of constraint solutions of coupled matrix 
equations, we construct an iterative algorithm. The presented iterative method can 
obtain the solutions and least form solutions to the coupled matrix equations with 
random coefficient matrices, higher random coefficient matrices, and known specific 
real coefficient matrices. In addition, if a group of matrices is given, we can easily 
compute the associated optimal approximation solutions. Moreover, the numerical 
examples show that the solutions to the coupled matrix equations can be obtained 
for any initial matrices in the absence of roundoff errors. This fully demonstrates the 
effectiveness of the presented algorithm. 


Chapter 4 


MCGLS Iterative Algorithm to Linear 
Conjugate Matrix Equation 


In this chapter, we study the generalized Sylvester-conjugate matrix equation 
XO AXBi+ X` CXD; = E, (4.0.1) 


with known matrices A; € ©?*", B; € "%1, C; e @*", Dj eC", E e ŒI and 
unknown matrix X € C™%” for i=1,2,...,p,7 = 1,2,..., t. It is obvious that this 
class of matrix equation includes various linear matrix equations such as Lyapunov, 
Sylvester, and the generalized Sylvester matrix equation as special cases. We mainly 
consider the following two problems. 


Problem 4.1. For given A; € ©", B; € CC, e Œ", Dj E C1 E e 0, 
i=1,2,...,p and j = 1,2,..., t, find X* € €"”” such that 


5 AiX*Bi+ 5 C; X* Dj — E 
=1 


i=l i= 


(4.0.2) 


= min 
xeon 


p t 
XO AXBi+ X` C;XD)- E 
i=l =] 


j= 


Problem 4.2. Let G, denote the solution set of problem 4.1, for given Xo € €"*", 
find the matrix X € S,, such that 


X — Xo|| = min ||X — Xoll. 4.0.3 
| ol] = min || oll (4.0.3) 
For X and Y two matrices in €”*”", we define the real inner product as 
(X, Y) = Reļtr( Y” X)]. The associated norm is the well-known Frobenius norm. For 
matrices R, A,B and X with appropriate dimension, a well-known property of the 
inner product is (R, AXB) = (A” RB", X). Two matrices X and Y are said to be 
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orthogonal if (X, Y) = 0. First of all, we introduce three lemmas that will be used in 


the next. And the proof line of lemma 4.2 is similar to the reference], 


Lemma 4.1. P'ILet U be an inner product space, V be a subspace of U, and V+ be 
the orthogonal complement subspace of V. For a given u € U, if there exists a 
vo E V such that ||u— vol] <||u— v|| holds for any v € V, then vo is unique and 
vo € V is the unique minimization vector in V if and only if (u— vo) L V, ie. 
(u = vo) E y+. 

Lemma 4.2. Assume that R is the residual of equation (4.0.1) corresponding to the 
matrix X € €”"*”, that is, R= E — $`}; 4X B; — DE C; D;. Then the matrix X 
is the least squares solution of equation (4.0.1) if 


P A D ee 
SAP RBI + X0; RD; =0. (4.0.4) 


i=l j=l 


Proof. We first define the linear subspace W = {F|F = $}; A,XB; + ys C;X Dj} 
with A; € OC" Bee! Cj e O*™" DEO"! F e, and Xe", 
i=1,2,.. p j=1,2,.. t. Now if we let P= 0? A)XB;+ 5}; C; Dj, then 
F € W. Therefore, for any F € W, we have 


(E— F, F) 
=(E- 5 A XB; 5 OjD,, Y AXB; + 5 C;XD;} 
i=l j=l il j=l 
= (RY ARBA ` C;XD;) 
i=l j=l 

P . a re 
= (Xp APRBN x) +2 j RD; X) 
= (So alee! + 3 C; RD;", X) 


Hence, if we let S7?_, A” RB! EGG; RD, = 0, the above equations show 
that (E — Ê, F} = 0. It follows from lemma 4.1 that (E — Ê) € WŁ. So the matrix 
X is the least squares solution of equation (4.0.1). Oo 


Lemma 4.3. If we let X is asolution of problem 4.1, then any solution X of problem 4.1 
can be expressed as X + Z where the matrix Z € €"" satisfies 


5 AiZBi+ X` C;ZD; =0. (4.0.5) 
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Proof. For any solution X of problem 4.1, if we define the matrix Z = X — X, then 


we have X = X+ Z. Now it is showed that equation (4.0.5) holds. By applying 
lemma 4.2, we can obtain 


2 


5 AiXBi+ o C;XD;— E 
i=1 j: 


j=1 


2 
Po to o 
= AiXBi+ X C;XD;- E 
i= j=1 
p : t 2 
=| $ A(X + 2) Bi+ $ O(X+2)D;- E 
= j=l 
p Per. = Ais 
= > A;ZB;i+ 5 C;ZD,;-R 
= j=l 
p t — . 
=|| $5 4:ZB:+ X` C;ZD;|| + | RI)? 
i= j=l 


+ || Rll? 


y AiZB;+ 5 CZD; 
j=1 


i=l $ 


+ IÈI’. 


p t 
XC AiZBi+ X C;ZD; 
El j=l 

This shows that the equation (4.0.5) holds. Oo 


4.1 MCGLS Iterative Algorithm and Convergence 
Analysis 


The CGLS method is a powerful method for solving the solution of large sparse least 
squares problem min,<¢"||b— Az||. In this section, we first propose an iterative 
algorithm by generalizing the CGLS method to solve problem 4.1, then present some 
basic properties of the algorithm. We also consider finding the least Frobenius norm 
solution to problem 4.1. 
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Algorithm 4.1. z(1) € R” is an initial matrix, r(1) = b— Ax(1), s(1) = A’ r(1), 
p(1) = s(1), y(1) = ||s(1)||?, for k = 1,2,3,..., repeat the following: 


a(k) = Ap(k), 
5(k) = IK) lla, 
( 


a(k +1) = 2(k) + 6(k) p(k), 
r(k+1) = r(k) — 6(k)q(k), 
s(k+1) = ATr(k+1), 

y(k+ 1) = |k + D1), 

Ak) = (k + 1)/7(K), 

p(k+1) = s(k+1) + 4(k)p(k). 


Based on the above CGLS method, we propose the following matrix form of the 
CGLS iterative algorithm (CGLS-M) to solve the least squares problem of the 
generalized Sylvester-conjugate matrix equation (4.0.1). 


Algorithm 4.2 


Step 1. Input matrices A; € ©?*", B; € C""", C) e @*", Dj EO", EE C*! and 
X(1) e C"*” for 1=1,2,...,p,7 = 1,2,...,¢; 
Step 2. Compute 


s(1) = JS AFRO)B! + 5G" RD," 


i=l 


j=l 
PO) = 80), 20) = S0; 
For k = 1,2,3,... repeat the following: 


Step 3. If || R(k)|| = 0, then stop and X(k) is the solution of equation (4.0.1), break; 
else if || R(k)|| 4 0 but ||S(k)|| = 0, then stop and X(k) is the solution of problem 
4.1, break; 
else k:= k+ 1; 
Step 4. Compute 


Q(k) = 5 A\P(k) Bi + D CjP(K)D; 
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+ 
t 

a arawe YTD), 
j=l 


Step 5. Go to step 3. 


Some basic properties of algorithm 4.1 are listed in the following lemmas. 


Lemma 4.4. For the sequences S(k), P(k) and Q(k) which are generated by algo- 
rithm 4.1, if there exists a positive number r, such that ||S(u)|| 40 and 
|| Q(u)|| 4 0, Vu = 1,2,...,r, then the following statements hold for u, w = 1,2,.. 
and u £ w. 

(1)(5(u), S(w)) = 0, 

(2)(Q(u), Q(w)) = 0, 

(3)(P(u), S(w)) = 0. 


Proof. Step 1: We prove the conclusion by induction. Because the real inner product 
is commutative, it is enough to prove three statements for 1<u<w<r. 
For u = 1, w = 2, by algorithm 4.1, we have 


(5(1), 5(2)) 
= (sw S(1) — 6(1) (x: A# Q(L) BE + Scram) ) 


= |S)? — ô( (se ator Das T'A) 


j=l 


= |S)? - (Yass, +Z cs02,00) 


i=1 j=l 


= [SW]? — 00), Q0)) = 0, 


4? 
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= A(1)|| QQ) |? + (00.508 Y csn) 


i=1 j= 


=A? - an AH (R(2) — R(1)) BH + $ 0; RO = ROD," s) 


1 


mi (2) — S(1), S(2)) = 0, 


=R] -3D 
and 
Step 2: In this case, for u< w< r we assume that 
(S(u), S(w)) =0,  (Q(u), Q(w)) =0, (P(u), S(w)) = 0. 


Thus, we can write 


(S(u), S(w+ 1) 
= (s0 sw — 8009S a Oe B+ OG" Qw) yp") ) 


= —6(w) (uw), YD A¥ Qu) B+ 1G" Q(w) io") 
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(P(u), S(w+ 1)) 


- (rw. S(w) — ò(w) (>: Al Q(w) BH + Soraa") ) 


j=l 


= (PA Q(u) BH + Soran") 


i=l j=l 


= -g(a 1)- RY A,S(w+1)Bi+ 3 C;S(w+ nD) 


i=l jel 


For u = w, we have 


(S(w), S(w+ 1)) 
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II 
kn 
& 
| 
= 
& 
IM 
= 
is 
& 
& 
+ 
Q 
6 
S&S 
2 
& 
<~ 


S CUTI + Aw}PCHD, ) 


Q(w), 2, AiS(w+1)Bi+ > C;S(w++1)D;)+24(w) aw) 
= A(w)|| QCu)||2 - -= (Rw 1) — R(w), 


= A(w)|| Q(w)||? -= Sw DI 


0, 


d(w) 
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(P(w), S(w+ 1)) 


= (rw) S(w) — òl) (x: AF Q(w) BE + So an) ) 


i=1 j=l 
p 
= ||5(w)|/° — 5( 03 A;P(w)Bi + $ CjP(w) Dj, Q( ) 
i=1 j=1 
By the principle of induction, we draw a conclusion. O 


Lemma 4.5. If there exists a positive number / such that ô(l) = 0 or ô(l) = œ in 
algorithm 4.1, then X(J) is a solution of problem 4.1. 


Proof. If 5(1) = 0, we have ||S(J)||? = 0. If 6(1) = œ, we have || Q(J)||? = 0. It is 
showed that 
ISOP = (S@) +4 AG — 1S0 1) +. ACL — DAL — 2) S(L- 2) + 
+4(1— 1). ..4(1)8(1), S(D) 
l 


= (P(), S()) 
= ( P(D, SS APR (I pals OG" ROD; ja 
Therefore, for 6(1) = 0 or 6(1) = co we have 
S) = YD AĦR() BE + >a C; ROD; =0. 


So by lemma 4.2, we can conclude that X(J) is the solution to problem 4.1. O 


Theorem 4.1. If the matrix equation (4.0.1) is consistent, then, for any arbitrary 
initial matrix X(1), the solution X* of problem 4.1 can be obtained by using algo- 
rithm 4.1 within a finite number of iterations in the absence of roundoff errors. 


Proof. By lemma 4.4, the set S(i), i = 1,2,3,...,m x nis an orthogonal basis of the 
real inner product space C™*%"” with dimension m x n. Therefore, we can obtain 
||S(m x n+1)|| = 0. It is also showed that X(m x n+ 1) isthe solution of problem 4.1 
in the absence of roundoff errors. O 


oe 4.2. uopo that the initial matrix is ? AFF(D)BE + 


iy i ©; a F()D; , where F(1)€€"*" is an arbitrary matrix, or especially 
X(1) = 0, then the solution X* generated by algorithm 4.1 is the least norm solution 
of problem 4.1. 
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Proof. Let the initial matrix be X(1) = S7?_, A” F() BY + SiO FUD: then, 
it follows from algorithm 4.1 that the generated matrix X(k) can be easily expressed 
as X(k) = J2] A" F(k)B? +10; FD; for certain matrices F(k) € €"*" 
for k= 2,3,.... This implies that there exists a matrix F* € €"*” such that 
X* = 5 AF F*BE + DE ey, Now if we let X” is an arbitrary solution of 
problem 4.1, then, by using lemma 4.3, there exists the matrix Z* € €”*” such that 
X = X*+Z* and EAA Bs X; 02 D; = 0. Thus, one can obtain 


P t 
(X*, Z) = > PIY T FI, r) 


i=1 j=l 
p too o 
= (PD AZB 5 cZn) =0. 
i=1 j=1 


By applying this relation, one can obtain 
Ş* 2 * *1]2 
IX |" = |X + z| 
|) 2 || 2 * * x) 2 x [| 2 (12 
= RHA +2, 2) = YH A S A. 


This shows that the solution X* is the least Frobenius norm solution of 
problem 4.1. o 


Similar tol), the minimization property of the proposed algorithm is stated as 
follows. This property shows that algorithm 4.1 converges smoothly. 


Theorem 4.3. For any initial matrix X(1) € €"*", we have 


p t 2 


XO AiX(k+1)Bi+ X` OG;X(+1)D;- E 


i=l j=l 


2 


= min 
Xey, 


? 


5 AiXBi+ 3 C;XD;-E 
i=1 


j=l 


where X(k+1) is generated by algorithm 4.1 at the k+1-th iteration and y, 
presents an affine subspace which has the following form 


Wr = X(1)+span(P(1), P(2),..., P(k)). 


Proof. For any matrix X € Y, it follows from the second formula in theorem 4.3 that 
there exist numbers 01, #2,...,%, such that 


k 
X= X(1)+ So mP(D). 
l=1 


Now we define the continuous and differentiable function f with respect to the 
variable &1,&2,..., k as 
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s k 
F (ei, 02, ..., 0%) = 5 +o uP 
i=l i=1 
t k je 
+X OXO) + So aiP())D; - E 
j=l 1=1 
By lemma 4.4 one can obtain 
f(o1, %2, ..., Hk) 
S t 
- [Saxos S orp, 
i=l j=l 
k 5 t 2 
+ Dm] Dd APOB + | CPO 
l=1 i=1 j=l 
2 L 2 
= ROP + X iR? — 200), RO). 
11 
Now we consider the problem of minimizing the function f(1, %2,...,a,). It is 


obvious that > 


minf(o1,%2,..., 04) = a 
a 


paket Y> xD, - E 


j=l 
For this function, the minimum occurs when 


o(a, A23- Ap) 


=0 for [=1,2; k: 
Ox) 0 or gy ’ 


Thus, we can get 


_ (QW, RO) 
IROI 


From algorithm 4.1, one can obtain 
R(1) = R) + 6(1— 1)QU-—1)+ô81-—2)Q(l-—2)+ --- +8(1)Q(1). 


Therefore, it follows from lemma 4.4 that 


(Q(), RO) (PO, Ei, AEROBE + Zia O; ROD,) 


ay = 


IROP QI? 
_ (PO, S) _ (S +All- 1)PU- 1), S0) 
IROI IROI? 
_ SOP s 
IROI? 4 


Thus, we complete the proof. O 
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By theorem 4.1, the solution generalized by algorithm 4.1 at the k+ 1-th itera- 
tion for any initial matrix minimizes the residual norm in the affine subspace y}. 


Also one has p 


s t 
> AX(k+DBi+ X CX(k+ DD; - E 
a = 


2 


SD AX (KB: + 5 C;X(k) D; — 
i=1 j=1 


which shows that the sequence of the norm of residuals || R(1)||, || R(2)||,... is 
monotonically decreasing. This decent property of the norm of the residuals shows 
that algorithm 4.1 processes fast and smooth convergence. 

Now we will solve problem 4.2. For a given matrix Xo, by problem 4.1 we can get 


min 
P C= iiai 


z A;XB,+ 5 C;XD;-E 


j=l 


Jax- Xo)B + oe Xo)Dj 


- ankn 


(8 -J7 4XoB; - Yo oxp |: 


If we let the set E = E— 5L 14i XoBi— D- 1Cj XoD; and Ay X— Xo, then 
problem 4.2 is equivalent to find the least Frobenius norm solution X} of 


JANB +5 OXD- By 


j=l 


? 


Xi P 


which can be computed by using algorithm 4.1 with the initial matrix X,(1) = 
yi AP FB? + De Fp? where F € C””” is an arbitrary matrix, or especially 


X,(1) = 0. Thus the solution of problem 4.2 ||X — Xo|| = min xec, || X — Xol| can be 
stated as 


X = X + Xo. 


It’s showed that based on the problem 4.1, we can solve the problem 4.2. In other 
words, we can obtain the solution of problem 4.2 by using the solution of problem 4.1. 


4.2 Numerical Example 


In this section, we shall give some numerical examples to illustrate the efficiency of 
algorithm 4.1. All the tests are performed by MATLAB with machine precision 
around 107!°. 
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Example 4.1. Find the least Frobenius norm solution of the following generalized 
Sylvester-conjugate matrix equation 


AXB+ CXD=M, (4.2.1) 
where 
1+t 1-4 6i 44-3: 
Au| 2+i 0 12 10 
~ |54+6i 2+3i 11-21 i P 
1 12 0 9i 
2 3-21 4+6i 9+8i 
g- |4+6i 1 12 9 
7 0 12 15 18 |? 
2-i -9i 12 11 
i 9 15 2i 9+2i —i i 6+8i 
cu} Ho 2+3 12 1 | 4i 19 0 H1 
~ | 18 1-9% 21 iP | 23 264% 9% 9 P 
9+8i 11 i Bi 23 0 6 8i 
4660 —5011i 6322 — 1536i 2161+1789% 6035+ 1940i 
m= | 14900-17871 13144 — 10581 5872+ 59831 12675 + 8798: 
~ | 12135 — 125097 12910-57097 4671+6089i 11126 + 4083: 
10031 + 8092: 12415+3909i 3793491261 5328 +12279% 


It can be verified that the generalized Sylvester-conjugate matrix equation (4.2.1) 
is consistent and has the solution 
4+3i 2+i 11 6 
9+6i 11+2i 8+9i 9 
9i 4 2 1li 
23 4 7 12 


If we let the initial matrix X, = 0, applying algorithm 4.1, we obtain the solution 
with the corresponding residual 


r(126) = 9.8915 x 1077%, 


and relative error 


e(126) = 1.3293 x 1071. 


The obtained results are presented in figures 4.2.1 and 4.2.2, where 


rą = logio|| E — AX(k)B— CX(k) D|], 
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and 
_1X@) -XI 


err(k) ixi 


If we let the initial matrices be X(1) = 0, X(1) = I4, X(1) = ones(4, 4), respec- 
tively, applying algorithm 4.1, the residual and the relative error of the solution are 


presented in figures 4.2.3 and 4.2.4. 


-15F CGLS- M 
- = — — LSQR-M 
-20 1 1 1 f i 1 
20 40 60 80 100 120 140 160 


k(iteration number) 


Fic. 4.2.1 — The residual of solution for example 4.1. 


e(k) 


1 1 
60 80 140 160 
k(iterative number) 


Ll 
100 120 


. 4.2.2 — The relative error of solution for example 4.1. 


Fic 
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* x, =ones(4,4) 


+ x, =zeros(4,4) 


-20 ! fi i fi 1 fi 
0 20 40 60 80 100 120 140 


k(iterative number) 


Fic. 4.2.3 — The residual of solution for different initial values for example 4.1. 


0 T T T 
* xX, =zeros(4,4) 
+ x, =ones(4,4) 
-5 F — xX, =|, 4 
€ 
D 
-10 F 4 
-15 , | i 1 f 1 
0 20 40 60 80 100 120 140 


k(iterative number) 


Fic. 4.2.4 — The relative error of solution for different initial values for example 4.1. 


Remark 1. From figures 4.2.1 and 4.2.2, the residual and the relative error of the 
solution to matrix equation (4.2.1) are reduced with the addition of an iterative 
number. It showed that the iterative solution converges to the exact solution. 
Moreover, with the addition of an iterative number, the residual and the relative 
error of the LSQR-M iterative algorithm are not varied. Finally, the residual and the 
relative error of the iterative algorithm are smaller than those of the LSQR-M 
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iterative algorithm. It is proved that our proposed method (MCGLS iterative 
method or CGLS-M iterative algorithm) is efficient and is a good algorithm. 


Remark 2. From figures 4.2.3 and 4.2.4, for the different initial value X(1) = 0, 
X(1) = I4, X(1) = ones(4,4), respectively, the iterative solution to the matrix 
equation (4.2.1) all converges to the exact solution to the matrix equation (4.2.1). 


Example 4.2. Find the least Frobenius norm solution of the following matrix 
equation 


AX+XD=M, (4.2.2) 


where 


12 

3i 

12 

2 
29+ 91 
89+ 91 


9+ 2% 
4i 
23 
23 
112 
11 


6+ 82 
11 
9 
81 
21 
4+ 281 


23 
3+ 40 
23 
18+ 97 |’ 
3i 
788 


i 
0 
9i 
6 
119 
3i 


—i 
19 
26+ i 
0 
123+ i 
2 


D= 


1+2i 11-31 11 2 


24+11i 
5+ 62 
1 
23 
34 


0 


ae 12 


43 
89 


1349 + 13102 
2951 + 28632 

574 + 36901 
—802 + 1004: 
14159 + 24171 
24695 — 15401 


2+3% 


12+6: 
12 
11 — 2i 
0 
21 
45i 


829 — 172% 

4222 + 221 
4159 — 9592 
1885 — 105% 
16561 + 12771 
29322 + 2897 


4+ 231 
10 
i 
9i 
99% 
2+3% 


34+ 52 
34 
134 457 
45i 
4+7i 


604 + 229% 


4948 4 


+ 3112 


6374 — 10831 


21104 
16974 4 


+ 827% 
+ 31402 


25160 4 


+ 20032 


11 

45 

3 ? 
4+9 

4 


1547 + 20294 
5997 + 7821 
5778 + 1662 
2515 + 76602 
2939 + 64942 
14052 — 2751 


8166 + 8462 


7743 — 217512 
14398 — 16992 
10150 + 65372 

6763 + 92221 
12010 — 18641: 


It can be verified that the generalized Sylvester-conjugate 
is consistent and has the solution 


2060 — 


53917 + 30542 


233292 


10406 — 32232 
62506 + 2197: 
11737 + 106897 
4965 — 1821527 


matrix equation (4.2.2) 
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4+3i 2+% 11 6 3i 67 
9+6i 11+2i 8+9% 9 23 34i 
x= 9i 4 2i lt 34102 124182 
23 4 t 12i 12+3i 78 
2+78i 2+9i 17 119 127 12 
56% 79 118 19 191 2371 


If we let the initial matrix X(1) =0, applying algorithm 4.1, we obtain the 
solution, which is 


4.0000 + 3.00002 2.0000 + 0.99999: 11.0000 
8.9999 + 6.00007 10.9999+ 2.0000: 7.9999 + 9.00002 
8.99992 3.9999 1.99997 

Ae 22.9999 3.9999 6.9999 
2.0000 + 77.9999; 2.0000 + 8.99992 17.0000 
56.0000 79.0000 117.9999 
6.0000 2.99992 67.0000 
9.0000 23.0000 33.9999% 
11.0000; 3.0000 + 1.00007 12.0000 + 18.0000: 
12.00002 12.0000 + 3.00002 78.0000 j 
118.9999 126.9999 11.9999 
19.0000 191.0000 237.0000 


with corresponding residual 


r(587) = 6.9270 x 107°, 


and relative error 


e(587) = 7.9381 x 1071". 


The obtained results are presented in figures 4.2.5 and 4.2.6, where 


ry = logyg||B — AX(k)B— CXD], 
and 
IX% — X| 
err k = ——_—_ 
() = — x] 


If we let the initial matrices be X(1) = 0, X(1) = I4, X(1) = ones(4, 4), respec- 
tively, applying algorithm 4.1, the residual and the relative error of solution are 
presented in figures 4.2.7 and 4.2.8. 
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r(k) 


0 100 200 300 400 500 600 


k( iteration number ) 


Fic. 4.2.5 — The residual of solution for example 4.2. 


0 100 200 300 400 500 600 
k(iterative number) 


Fic. 4.2.6 — The relative error of solution for example 4.2. 


Remark 3. Figures 4.2.5 and 4.2.6, showed that the iterative solution converges to 
the exact solution. Moreover, with the addition of the iterative number, the residual 
and the relative error of the iterative algorithm are smaller than those of the 
LSQR-M iterative algorithm. It is proved that our proposed method (CGLS-M 
iterative algorithm) is efficient and is a good algorithm. From figures 4.2.7 and 4.2.8, 
for the different initial value X(1) = 0, X(1) = I4, X(1) = ones(4, 4), respectively, 
the iterative solution to the matrix equation (4.2.2) all converges to its exact 
solution. 
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== Xl 


== X ,=ones(6,6) 


== X ,=zeros(6,6) 


-20 : 
0 100 200 300 400 500 600 


k(iterative number) 


Fic. 4.2.7 — The residual of solution for different initial values for example 4.2. 


0 r r T 
—— X ,=zero(6,6) 
—X,=l, 
-5f — — X,=ones(6,6) 7 
g€ 
o 
-10 H 4 
-15 ! , fl 1 1 
0 100 200 300 400 500 600 


k(iterative number) 


Fic. 4.2.8 — The relative error of solution for different initial values for example 4.2. 


4.3 Control Application 


In linear systems, the problem of eigenstructure assignment is to find a control law 
such that the system matrix of the closed-loop system has the desired eigenvalues 
and multiplicities, and simultaneously determines the corresponding eigenvectors 


and generalized eigenvectors. 
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Now we consider the following discrete-time anti-linear system 


a(t+1) = Ax(t) + Bu(t), (4.3.1) 
where x(t) € ©” is the state, and u(t) € C” is the input. A € €"*" and C € €"*" are 
the system matrix and input matrix, respectively. If the state feedback 


u(t) = Ka(t), (4.3.2) 


is applied to the system (4.3.1), the closed-loop system is obtained as 


a(t+1) = (A+ BR)a(0. (4.3.3) 


Given a prescribed matrix F € €"*", find a state feedback controller in the form 
of (4.3.2) such that the system matrix (A+ BK) of the closed-loop system (4.3.3) is 
consimilar to the matrix F, and simultaneously determine a nonsingular matrix 
X €C"" satisfying 


X "(A+ BE)X =F. (4.3.4) 
Due to the non-singularity of X, the equation (4.3.4) can equivalently written as 


AX + BKX = XF. (4.3.5) 


Let KX = W, then, the equation (4.3.5) can be transformed into the following 
equation 


AX + BW = XF, (4.3.6) 


which is the so-called Sylvester conjugate matrix equation. By algorithm 4.1, we can 
obtain the solution of equation (4.3.6). 


4.4 Conclusions 


In this chapter, the MCGLS iterative algorithm is constructed to solve the least 
Frobenius norm solution of the generalized Sylvester-conjugate matrix equa- 
tion (4.0.1). By this algorithm, for any initial matrix X(1), a solution X* can be 
obtained in finite iteration steps in the absence of roundoff errors, and the least 
Frobenius norm solution can be obtained by choosing any initial matrix. In addition, 
by use of this iterative method, the optimal approximation solution X to a given 
matrix Xo can be derived by first finding the least Frobenius norm solution of a new 
corresponding matrix equation. And we have checked the obtained theory by the 
numerical examples. The given numerical examples show that the proposed iterative 


algorithms are quite more efficient than the existing LSQR iterative algorithm 93.4), 


Chapter 5 


MCGLS Iterative Algorithm to Linear 
Conjugate Transpose Matrix Equation 


The aim of this chapter is to present an iterative algorithm for solving the gener- 
alized Sylvester conjugate transpose matrix equation. There are many problems 
such as in mathematics, physics, and engineering, leading to solving linear matrix 
equations. For example, a digital filter can be characterized by state variable 
equations 


a(n+1) = Aa(n) + bu(n), (5.0.1) 
and 
y(n) = cx(n) + du(n). (5.0.2) 
The solutions K and W of the Lyapunov matrix equations 
K = AKAT + bb", (5.0.3) 
and 
W = ATWA + cfc, (5.0.4) 


can analyze the quantization noise generated by a digital filter), It can be shown 
that certain control problem, such as pole/eigenstructure assignment and observe 
design of (5.0.1), are closely related with the following generalized Sylvester matrix 
equation 

p 4 

XO A:XBr+ X CYD; = E. (5.0.5) 
k=1 j=l 


The generalized Sylvester conjugate transpose matrix equation 


& 


r t k u 
ANB 5 C;XD;+ 5 G,XTH,+ 5 MX" N, = E, (5.0.6) 
=1 j=1 s=1 l=1 
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with known matrices A; € @?*", B; € ©", Cj e O*", DEO" G,eO™, 
H, € ©", Mı € ©", Ni € C1, E € ŒI and unknown matrix X € C™”” for 
i= 1,2,..., r; j= 1,2,..., t;s = 1,2,..., k; l= 1,2,...,u., which is discussed in 
this chapter, is the generalization of the above matrix equation (5.0.5). 
Obviously, this class of matrix equation includes various linear matrix equations 
such as Lyapunov, Sylvester and the generalized Sylvester matrix equations as 
special cases. 

This chapter is concerned to find the least squares solution of generalized 
Sylvester-conjugate transpose matrix equation (5.0.6) by generalizing CGLS itera- 
tive algorithm. For details, we mainly consider the following two problems. 


Problem 5.1. For given A; € @*™, B; € ©", Cj e ©", Dj e C1, G, e 0”, 


H, € ©"! M; E€ Œ", N, EO! BE O*17(=1,2,...,p; j= 1,2,..., t;s = 1,2, 
... k and 1=1,2,...,u. find X* € €”*” such that 


r t 2a. k u 
AiX*Bi+ X C)X*Dj + X GXT H.+ $ MiX" N,- E 
i=1 j=1 s=1 [i 
r t — k u 
= min |Ð 4:XBi+ X C;XD;+ X GXH, + X MıX" N, — El. 
TECT = 


i=l j=l s=1 Ei 


(5.0.7) 


Problem 5.2. Let G, denote the solution set of problem 5.1, for given Xo € €”*”, 
find the matrix X € S,, such that 


|X — Xol| = min || X — Xoll- (5.0.8) 


Firstly, let J, and S, denote the n x n unit matrix and reverse unit matrix 
respectively. For X and Y two matrices in ©”, we define the real inner product as 
(X, Y) = Reļtr( Y” X)]. The associated norm is the well-known Frobenius norm. For 
matrices R, A,B and X with appropriate dimension, a well-known property of the 
inner product is (R, AXB) = (A” RB", X}. Two matrices X and Y are said to be 
orthogonal if (X, Y) = 0. First of all, we present two lemmas. And the proof line of 
lemma 5.2 is similar to the reference”), 


Lemma 5.1. P'ILet U be an inner product space, V be a subspace of U, and V+ be 
the orthogonal complement subspace of V. Given w € U, if there exists a wọ € V 
such that ||w — vol] < ||w — || holds for any v € V, then v is unique and up € V is 
the unique minimization vector in V if and only if (w — vo) L V, i.e. (w— vo) € vt. 


Lemma 5.2. Assume that Ñ is the residual of equation (5.0.6) corresponding to the 
a F a p A T A oT 

matrix Xe", that is, R= E- Di1 4iX B; — Yi- 0X Dj- Yi GX H,- 

SMX "N |. Then the matrix X is the least squares solution of equation (5.0.6) if 
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RG, + 3 NIR? M, =0. (5.0.9) 
=1 


Parast Do" RD; "4 mR 


Proof. We first define the linear subspace W = {F|F = X; 4iXBi+ 
Siar C7XDj+ TE GXTH.+ TL MX" Ni} with Ape ©", Bi e C4, 
Cj E CP" Dj E CG, E OP" Hs E€ C1 MeO" Ni E C” FEO! Fe 
CP! and X e ©""" i=1,2,...,9; j =1,2,..., t;s = 1,2,...,k and 1=1,2,...,u 
Next, if we let P=, A,XBi+ 04, 0),XD)+ 01 ,G.X° H +E MA" Na 
then F € W holds. Therefore, for any F € W, one can obtain 


i=1 j=l s=1 


k u 
XO AXBi+ X O;XDj+ X` GXH, + 2 MX” mi) 


RAND + Y CXDj+ DCX, + Mx 


= j=l s=1 l= 


a k 
AF RBY, x)4 (oa C,” RD; x) + ( HR’ G,, x) 
i=1 s=1 


II 
ee 
~x A 


II 
i 


a =H a NER EER Y ee 
In this case, if we suppose EARST RD) + CL HAR Gs + 
«NR M, = 0, then by the above equations it is apparent that (E — F, F) = 0. 
By lemma 5.1, we have (E — F) € W+. Thus, the matrix X is the least squares 
solution of equation (5.0.6). oO 


Lemma 5.3. If we let X be a solution of problem 5.1, then any solution X of problem 
5.1 can be expressed as X + Z where the matrix Z € €"*" satisfies 


57 AZB.+ Y ED, + Y^ G,Z"H, + YO M,Z" N, =0. (5.0.10) 


i=1 j=l =l l=1 
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Proof. For any solution X of problem 5.1, if we define the matrix Z = X — X, then 
X = X + Z holds. Now it is showed that equation (5.0.10) holds. By applying lemma 
5.2, we can obtain 

2 


i=l 


r = k u 
ŅC A XB. + 5 C)XD)+ X G. H,+ Y MX" N,- E 
j=1 s=1 l=1 


y b a k u 2 
SD AžB:+ $` CXD + GATH, + YO MN -E 
i=l j=l s=1 I=1 

r t 
N\A + Z)Bi+ X Cj(X+ ZD; 


i=l j=l 


k 2 
+ pa aes TH+ SMX 42)" Ni- E 


s= {l 


k u 2 
A;ZB;i+ > C;ZD;+ 5 Ga HA 5 MZ" N,- È 


i=l j=l s=1 EI 


2 
E 
+|[Rl 


3 


f k u 
AiZBi+ X C;ZD;+ 2 G.Z"H,+ 3 MZ” N; 


i=1 j=l 


-2( So ae +S oD, +3°6,27H, +o Mz Na R) 


i=1 = =l l=1 


2 
= 57 AZB; +2020, ar H, + YO MZ"N, +a 
i=1 j=l s=1 l=1 
t _ k u 
= (25 AF RBE + SO; RD; +Y H.R’ G+ 5 mkm) 
i=1 j=1 s=1 l=1 
2 
aloe ZB; + Sam + sa, ZTH, p MIZ" N, + |È. 
=1 j=l s=l1 
Therefore, the equation (5.0.9) holds. Oo 


5.1 MCGLS Iterative Algorithm and Convergence 
Analysis 


In this section, firstly, in order to solve problem 5.1 an iterative algorithm is pro- 
posed, then some basic properties of the algorithm are given. Next finding the least 
Frobenius norm solution to problem 5.2 is discussed. As is well known, the CGLS 
method is a powerful method for obtaining the solution of large sparse least squares 
problem min,¢¢||6— Az||. It is stated as follows. 
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Algorithm CGLS."9! 2(1)e" is an initial guess, r(1) = b— Az(1), 
s(1) = AT r(1), p(1) = s(1), y(1) = || s(4) ||’, for k = 1,2,3,... repeat the following: 


q(k) = Ap(k), 

5(k) = (k) /lla l”, 

x(k +1) = 2(k) + 6(k) p(k), 
r(k+1) = r(k) — ô(k)q(k), 
s(k+1) = ATr(k+1), 

y(k+ 1) = |ls(+ DI), 

Ak) = (k + 1)/7(K), 

p(k+1) = s(k+1) + 4(k)p(k). 


For solving the least squares problem of the generalized Sylvester-conjugate 
transpose matrix equation (5.0.6), based on the above CGLS method in vector form, 
the following matrix form of the CGLS iterative algorithm (MCGLS or CGLS-M) is 
presented. 


Algorithm 5.1 


Step 1. Input matrices A; E€ ©'*", Bye C4, Cj EO*" Dj E C1, GeO, 

H, € C” Mie OP", Nye C% Ee, (=1,2,...,.p; j=1,2,..., t;s = 
2,...,k and 1=1,2,...,u. and X(1) € C”*”; 

Step 2. Compute 


i=1 j=1 
k u 
-X GX Mı X1)" Ni; 
s=1 l=1 
=Y AF ROBE +Y O; ROD; 
i=1 j=1 
k u 
+ X ARO) G, + ıR(1)” My; 
s=1 l=1 


For k = 1,2,3,... repeat the following: 
Step 3. If || R(k)|| = 0, then stop and X(k) is the solution of equation (5.0.6), break; 
else if || R(k)|| 4 0 but ||S(k)|| = 0, then stop and X(k) is the solution of problem 
5.1, break; 
else k:= k+ 1; 
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Step 4. Compute 


a 
a 
| 
= 
Í 
D 
>H 


7 R(k+1) BE + So R(k+1)D; 


i=1 j=l 


k 
+ SOA R(k+1) "G+ SO NiR(k +1)" Mı 


=l l=1 


t 
o(Satawat T aan) 
j=l 


Step 5. Go to step 3. 


Some basic properties of algorithm 5.1 are listed in the following lemmas. 


Lemma 5.4. For the sequences S(k), P(k) and Q(k) which are generated by algo- 
rithm 5.1, if there exists a positive number r, such that ||S(u)|| 40 and 
|| Q(u)|| 4 0, Vu = 1,2,..., 7, then the following statements hold for u, w = 1,2,...,r 
and u Æ w. 

(1)(5(u), S(w)) = 0, 

(2)(Q(u), Q(w)) = 0, 

(3)(P(u), S(w)) = 0. 


Proof. Step 1: We prove the conclusion by induction. Because the real inner product 
is commutative, it is enough to prove three statements for 1< u<w<r. 


For u = 1, w = 2, by applying of algorithm 5.1, we obtain 
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2 ey Saa (Sara A” Q(1) BE + Soan) 
= eres > NQ yan) 

ISP = sd Da DB + TOD, 
+ YOTO) T; + ¥ 90") 

ap» A,S(1) By + 3 CS1) D; 


iŞ 3 G,S(1)7H,+ S5 M50)" N, a) 
s=1 l=1 


ISW IP - 80) (Q0), Q0) = 0, 


II 


h 
ll 
bi 


II 


II 


© 
Ih “2s 
> 
X 


© 
E 
M- 
> 
Y 
© 
& 
+ 
M 
© 
© 
5 


i 
im 
T 


E eS, ob SO 
© 
T iM 
Q 
M: hy 
> © Ð 
mo N 
ws N 
SF 
a LY 
X 
v 
© 
zZ 
n 


WP0))B:+ £ GCO APOD, 


G,(5(2) + A(1) P(1)) 7H, + 2 MS) +A PO)N) 


acu) +o Q0), È AS2)B.+ X CID; 


TOR 


h 
Ii 
= 


l 
> 
PEEN: 
jan 
= 


+ É G,8(2)" Hy + $ M)S(2)" Ni) 
l=1 


s=1 


= ACI QC? = say (YAN RO) - RABE 


+ DO R- RO)D;" + HARE) 
-Rì 


B+ E NAR) - R(1))" Mh, S) 
1 


=H =g Se 
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and 


Step 2: Now for u<w<r we assume that 
(S(u), S(w)) =0, (Qu), Q(w)) =0, (P(u), S(w)) = 0. 
Thus, we can write 


(S(u), S(w+ 1)) 


= (ss) A009 (So Arau LESCA Qw) 1p) 


= —d(w) (a). > AF Q(w) yet a" Qw) 


k 
+X H, Qw T+ Yo M 


= —6(w)( >) AiS(u) Bit © C;S(u)D;+ 5 G,S(u)TH 


= (0.33 A;P(w+1)Bi+ C;P(w+1)D; 


i=1 j=l 


k u 
+X GP(w+1)"H,+ X MıP(w+ nm) 


s=1 l=1 


MCGLS Iterative Algorithm to Linear Conjugate Transpose Matrix Equation 83 


i=l j=l 


k u 
+ G S(w+1)"H,+ X MiS(wt1)" N+ Aw) aw) 


s=1 l=1 


k u 


s=1 l=1 


-h AŤ (R(u+1)-— pats eH" R(u+ 1) = R(u))D;" 


+ OH (R(ut 1) —R Ti+ JO NAR (u+1)—- agin 


= (S(u+ 1) — S(u), S(w+1)}=0, 


= (PWs tn (32 A ote LEDIGA Qu) 
+ 


YT.) Gt So NQ) EN 


s= l=1 


=t l=1 
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For u = w, we have 


(S(w), S(w+ 1)) 


(Q(w), Q(w+ 1)) 


jal 


k u 
T 
+ 3 G|(w+1)" H, + > MiP i'm) 
g= =1 


= Co S Ai(S(w+1)+4(w)P(w))Bi+ Xo C,(S(w+ 1) + A(w) P(w))D; 


i=l j=l 


k u 
+ YO G(S(w+1)+4(w)P(w)) Hs + X` M(S(w+1) HUDPWN) 


s=1 l=1 
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k u 
onesie Fuser essay 


=x — 55 TERE 0), J AS(u + 1B, 


t 
+ X C;S(w+1)D;+ 5 G.S(w+1)" H, + 5 MıS(w+ tm) 


j=l s=1 =1 


= A(w)|| Qw ~ say an (w+1) — R(w)) BP 


= HAW P — 5 (w+) = S), Sw 1) 
= HoW) — zrl sw DI? = 0, 


By the principle of induction, we draw the conclusion. O 
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Lemma 5.5. If there exists a positive number l such that ô(l) = 0 or ô(l) = œ in 
algorithm 5.1, then X(1) is a solution of problem 5.1. 


Proof. If 5(1) = 0, we have ||S(1)||? =0. If 5(2) = œ, we have ||Q(J)||’ = 0. It is 
showed that 


ISO 


l| 
a 
iM. 
= 
x 
5 
+ 
M- 
> ee 
ŞI 
E: 
Tage 
cS: 


Therefore, for 6(1) = 0 or 6(1) = œo we have 


Pp t SET 
S() = XC AF RBE + X C; ROD; = 0. 
i=1 j=l 


So by lemma 5.2 we can conclude that X(1) is the solution of problem 5.1. o 


Theorem 5.1. If the matrix equation (5.0.6) is consistent, then, for any arbitrary 
initial matrix X(l), the solution X* of the problem 5.1 can be obtained by using 
algorithm 5.1 within a finite iterative steps in the absence of roundoff errors. 


Proof. By lemma 5.4, the set §(i), i = 1,2,3,...,m x nis an orthogonal basis of the 
real inner product space Ç” with dimension m x n. Therefore, we can obtain 
||S(m x n+ 1)|| = 0. It is also showed that X(m x n+ 1) is the solution of problem 
5.1 in the absence of roundoff errors. O 


Theorem 5.2. Supposed that the initial matrix is PAM RF(DBE+ 
SG POD, where F(1) €€"*" is an arbitrary matrix, or especially 


X(1) = 0, then the solution X* generated by algorithm 5.1 is the least norm solution 
of problem 5.1. 


Proof. Let the initial matrix be X(1) = $>? AF F() BY + 5G FO D”, then, 
it follows from algorithm 5.1 that the generated matrix X (k) can be easily expressed 
as X(k) = $? AF F(k) BE +20 FAD for certain matrices F(k) € €"*" 
for k= 2,3,.... This implies that there exists a matrix F* € €"*" such that 
X* = 50 AF F*BE + 0, To., Now if we let X” is an arbitrary solution of 
problem 5.1, then, by using lemma 5.3, there exists the matrix Z* € €"*” such that 
X = X*+Z* and yee AZ" Bit D; 02 D; = 0. Thus, one can obtain 
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(X", 2") 
p t 
= (X APR REA SO; FD, z) 
i=1 j=1 
P t BES 
= (P DAZD 5 cZn) =0. 
i=1 j=1 


By applying the relation above, one can obtain 
7*2 * *]]2 
|X E = X*+ 2" 
*]]2 |) 2 * * *]]2 1) 2 * 12 
= POF YAY E AX, 2) = XP + IA Se 
This shows that the solution X* is the least Frobenius norm solution of 
problem 5.1. o 


Similar to), the minimization property of the proposed algorithm is stated as 
follows. This property shows that algorithm 5.1 converges smoothly. 


Theorem 5.3. For any initial matrix X(1) € €”*", we have 
r t 
XO AX(k+1)Bi+ XC CiX(K+1)D; 


i=1 j=l 


k u 2 
+O GX(k+1)"H,+ X MiX(k+1)"N,- E 


s=1 l=1 


2 


? 


r t k u 
= min 2 AiXBi+ X_ C;XD;+ X G.XTH.+ D MıX” N,- E 


jel sl 
(5.1.1) 


where X(k+ 1) is generated by algorithm 5.1 at the k+ 1-th iteration and y, 
presents an affine subspace which has the following form 


W, = X(1) + span(P(1), P(2),..., P(k)). (5.1.2) 


Proof. For any matrix X € y}, it follows from equation (5.1.2) that there exist 
numbers 0), %2,...,%, such that 


i 
X= X(1)+ X uP()). 
l=1 


Now we define the continuous and differentiable function f with respect to the 
variable 01, #2,...,% as 
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f(a, %2, a tip) 


r 


= |X Ai(X(1) + SaPo) ))Bi+ 3 CX) + S5 aP(D)D, 
j=l I=1 


£ 


k k u k 
+Y G(X()+ y aP(l))"Hs+ XO M(X) + X uP())"N, - E 
l=1 I=1 


s=1 l=1 


Due to lemma 5.4 one can obtain 


f(%1, %2,- Ap) 

r t k 

= |X AX()Bi+ X C)XMD)+ SGX)" H+ X MX)" N- E 
i=1 j=l s=1 l=1 

k r t k 2 
+X aD POB: + X CG POD + X GPH, + XO MPD" NY] 

l=1 i=1 j= s=1 l=1 

= || RQ)? + So LADI? — 201(Q(1), RCL). 


Now we consider the problem of minimizing the function f(«1, %,. 
obvious that 


.., 0x). It is 


minf(%, UD, ++ +5 ap) 
my 

p t _ k u 2 

= min||X_ 4:XBı+ X` CjXD;+ X G.XTH.+ X MiX"N|-E 


Xek j=l s=l 1 


According to this function, the minimum occurs when 


O( 1, 2, ..-, Xk) 


=0 f =l ak 
ða or pss ’ 


Consequently, we can get 


a) = 


(QW, RO) 
ROI 


Since algorithm 5.1, one can obtain 
R(1) = RI) + 6(1— 1) Q(1— 1) + 6(1— 2) QU — 2) + --- +8(1)Q(1). 


Therefore, it follows from lemma 5.4 that 
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— (QM), RM) 


| QQ)? 
(PO; Ei AP ROBE + Dia O ROD + DL, ARO T+ Di NRM) 
7 QM? 
_ (PO, SD) _ (8) +A- YPU= 1), 8D) _ WSOP L sep, 
IROI? IROI? IROI? 
By this means, we complete the proof. O 


By theorem 5.1, the solution generalized by algorithm 5.1 at the k+ 1-th 
iteration for any initial matrix minimizes the residual norm in the affine subspace 
W, Also one has 


k 
57 AX (k+1)B; + ox k+)Dj+ XO G.X(k+)7H 
s=1 


i=1 j=l 


2 


+ YO MiX(k+)"N,- E 
l=1 


? 


s t k u 
< > A,X(k) Bit > C;X(k)D; + 2 GX(k)" H, + X MıX(k)” N, — E 


l=1 


(5.1.3) 


which shows that the sequence of the norm of residuals || R(1)||, || R(2)||,... is 
monotonically decreasing. This decent property of the norm of the residuals shows 
that the algorithm 5.1 processes fast and smoothly convergence. 

Now we will solve problem 5.2. For a Ai matrix Xo by problem 5.1, we can get 


SAB D CXD; + D GX? H.+ So MX" Ni; E 


h- 
xec j=l s=l [=I 


Xe zom n n 


Da X- Xo)Bi+ Y CXX) X — Xo) D; 


j=l 


k u 
+ XO G(X- Xo)" H.+ 3 M(X- Xo)" N, 


s=1 l=1 


-(s 2S ange DCD; GASH SMX vi) 


i=1 j=l =l 


If we let the set By = E- 58,4: XoB:i — Di CyXoDj — NL GXI H, — 
3M ae N; and Xı = X — Xo, then problem 5.2 is equivalent to find the least 
Frobenius norm solution X} of 
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min 
xiec™ 


? 


r t k u 
> AiX1 Bit X C;XiDj+ X G.XTH.+ X. MXP, - E, 
i=1 j=l s=1 l=1 


which can be computed by using algorithm 5.1 with the initial matrix X,(1) = 


Di AP FB! + tO; FD! + AFG, + ELNE" M where F € ©™" is 
an arbitrary matrix, or especially X,(1) =0. Thus the solution of problem 5.2 
X — Xo|| can be stated as 


X = X + Xo. 


|X = Xoll = minyeG, 


It’s showed that we can solve the problem 5.2 based on the problem 5.1. In other 
words, we can obtain the solution of problem 5.2 by using the solution of problem 5.1. 


5.2 Numerical Example 


In this section, in order to illustrate the efficiency of algorithm 5.1, two numerical 
examples are given. All the tests are performed by MATLAB with machine precision 


around 107!°, 


Example 5.1. Find the least Frobenius norm solution of the following matrix 
equation 


AXB+ CXD+ EX" F4GXTH=M, (5.2.1) 
where 
5176 +1755 10683+3023i 327745921:  10579+4432% 

M 30638 +2241 20539-8851 21270 — 454i 23668 +8249i 
49038 — 1619i 33221 —13413i 39726 — 10567i 3453341371i |’ 
152494156521 21330+7577i  5458+8704i 14865 + 133067 

1+i 1-i 6i 443% i 9 15 2i 

a-| 2t+i 0 12 10 cu{ H 2+3i 12 1 
~ | 5462 2+3i 11-2) i P7 | 18 1-9 21 ¢ |’ 

1 12 0 9i 9+8i 11 i Bi 

2 3—2i 4+6i 9+8i —i 8 1 2i 

gp- |4+6i ll 12 9 p-| 1 241-3 2 1 
= 0 12 15 18 |’ | 78 i 2h ip 

2-1 -9 12 11 9-8: 11 i —8i 
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3 9-4 15 2+4 a 9 1—5i 2 

H= 11 243% 1+2i 11 F= 11 2+31 12 11 
18 11+9i 21 i , 18 —9i 21 ay? 
8i 21 =i 8-14 9+8i 1-8 9 0 


9+2i —i i 6+8i 
4i 19 0 11 
23 26+i 9i 9 
23 0 6 8i 


D= G= 


It can be verified that the generalized Sylvester conjugate transpose matrix 
equation (5.2.1) are consistent and have the solution 


4+3i 241% 11 6 
9+6i 11+2i 8+9% 9 
9i 4 2i 112 
23 4 7 12 


X= 


If we let the initial matrix X, = 0, by using algorithm 5.1, we obtain the solution 


4.0000 + 3.0000; 2.0000 + 1.00002 10.9999 5.9999 

X(133) = 8.9999 + 6.00007 11.0000 + 2.00007 &.0000+ 9.0000: 9.0000 
8.99994 4.0000 1.99992 11.0000: |’ 

22.9999 3.9999 7.0000 12.0000 


with corresponding residual 
r(133) = 4.7116 x 10-™, 
and relative error 
e(133) = 2.6266 x 107”. 
The obtained results are presented in figures 5.2.1 and 5.2.2, where 
ry = logyo|| M — AX(k)B— CX(k)D— EX(k)" F — GX(k)" Hl, 
and 


_ (XG) = XI 


err(k) ixi 


If we let the initial matrix X(1) = 0, X(1) = I4, X(1) = ones(4, 4), respectively, 
according to algorithm 5.1, the residual and the relative error of solution are 
presented in figures 5.2.3 and 5.2.4. 


Remark 1. From figures 5.2.1 and 5.2.2, the residual and the relative error of the 
solution to matrix equation (5.2.1) are reduced with the addition of an iterative 
number. It showed that the iterative solution converges to the exact solution. 
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r(k) 


0 20 40 60 80 100 120 140 160 
iteration number k 


Fic. 5.2.1 — The residual of solution for example 5.1. 


e(k) 


0 20 40 60 80 100 120 140 160 
iteration number k 


Fic. 5.2.2 — The relative error of solution for example 5.1. 


Moreover, with the addition of an iterative number, the residual and the relative 
error of the LSQR-M iterative algorithm are not varied. Finally, the residual and the 
relative error of the iterative algorithm are smaller than those of the LSQR-M 
iterative algorithm. It is proved that our proposed method (MCGLS iterative 
algorithm or CGLS-M iterative algorithm) is efficient and is a good algorithm. 
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= X=, 
* x, =ones(4,4) 
oF + X,=zeros(4,4) | J 
-5 F a 
€ 
-10- 4 
-15} a | 
+ 
-20 ! 1 1 1 1 1 
0 20 40 60 80 100 120 140 


iteration number k 


Fic. 5.2.3 — The relative error of solution for different initial values for example 5.1. 


Remark 2. From figure 5.2.3, for the different initial value X(1) =0, X(1) = 
I,, X(1) = ones(4,4), respectively, the iterative solution to the matrix equa- 
tion (5.2.1) all converges to the exact solution to the matrix equation (5.2.1). 


Example 5.2. Find the least Frobenius norm solution of the following matrix 
equation 


AXB+ CXD+ EX" F+ GXTH =M, (5.2.2) 


where 


A = rand(6, 7) + ix rand(6, 7), B = rand(5, 4) + i x rand (5, 4), 


C = rand(6, 7) + ix rand(6, 7), D = rand(5, 4) + i x rand(5, 4), 


E = rand(6, 5) + i x rand(6, 5), F = rand(7, 4) + i * rand(7, 4), 


G = rand(6, 5) + ix rand(6, 5), H = rand(7, 4) + i x rand(7, 4), 


—1.1212 + 36.84787 0.2336 + 32.7105; 0.4078 + 32.5045; 5.5394 + 29.9953: 
—5.7270 + 32.8779i —8.4829 + 28.77012 —4.6524 + 30.68062 —1.1100 + 27.3557i 
—1.1063 + 37.1070; —2.1256 + 35.1041i 1.4087 + 34.2908: 5.4257 + 30.3026: 
—1.2607 + 24.48881 —4.0543 + 21.80702 0.8941 + 24.52971 3.5789 + 20.1358: 
—2.9581 + 34.7771i —4.3860 + 31.01652 —1.5855+ 33.70162 1.2014 + 28.1810; 
—6.5203 + 25.76371 —7.0275 + 22.1274i —5.4346 + 24.7957i 0.5099 + 20.4696 


M= 
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It can be verified that the generalized Sylvester conjugate transpose matrix 
equation (5.2.2) are consistent and have the solution 


0.6273 + 0.61647 0.6173+0.98832 0.8044 + 0.52782 
0.0216 + 0.93977 0.5754+ 0.76682 0.9861 + 0.41162 
0.9106 + 0.35457 0.5301 +0.33672 0.0299 + 0.60262 
X = | 0.8006 + 0.41062 0.2751+0.66242 0.5357 + 0.75051 
0.7458 + 0.98437 0.2486 + 0.24422 0.0870 + 0.58352 
0.8131 + 0.94567 0.4516+0.29552 0.8021 + 0.55182 
0.3833 + 0.67667 0.2277 + 0.68022 0.9891 + 0.58362 


0.0669 + 0.51187 0.8990 + 0.88652 
0.9394 + 0.08267 0.6259 + 0.45472 
0.0182 + 0.71967 0.1379 + 0.41342 
0.6838 + 0.99627 0.2178+ 0.21772 
0.7837 + 0.35457 0.1821 + 0.12572 
0.5341 + 0.9713 0.0418 + 0.3089 
0.8854 + 0.34647 0.1069 + 0.72612 


If we let the initial matrix X(1) = 0, according to algorithm 5.1, we obtain the 
solutions with corresponding residual 


r(111) = 5.4178 x 107". 
The obtained results are presented in figure 5.2.4, where 


r, = logyo||M — AX(k)B— CX(k)D — EX(k)" F — GX(k)" All. 


* X ,=ones(7,5) 


“BE ‘ 
10+ % 
12+ KI 
* 
-14b % 
* 
46 i i i i 
0 20 40 60 80 100 120 


iteration number k 


Fic. 5.2.4 — The residual of solution for example 5.2. 
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Remark 3. Figure 5.2.4 showed that the iterative solution converges to the exact 
solution for any random coefficient matrices. Moreover, with the addition of an 
iterative number, the residual of the iterative algorithm is smaller. It is proved that 
our proposed method (CGLS-M iterative algorithm) is feasible and is a magnificent 
algorithm. 


5.3 Conclusions 


In order to solve the least Frobenius norm solution of the generalized Sylvester 
conjugate transpose matrix equation (5.0.6), we constructed the CGLS-M iterative 
algorithm in this chapter by extending the classical CGLS iterative algorithm. Due 
to this newly presented iterative algorithm, for any initial matrix X(1), a solution 
X* can be obtained in finite iteration steps in the absence of roundoff errors, what is 
more, the least Frobenius norm solution can also be obtained by choosing any initial 
matrix. Besides, by use of this iterative method, if a matrix Xo is given, then the 
optimal approximation solution X can be derived by first finding the least Frobenius 
norm solution of a new corresponding matrix equation. Furthermore, two numerical 
examples are given to check the obtained theory. It is worth noting that the coef- 
ficient matrices of the second numerical example are random matrices. It shows that 
the proposed iterative algorithm is quite more efficient than the existing LSQR 


iterative algorithm”? 93,94], 


Chapter 6 


MCGLS Iterative Algorithm to Coupled 
Linear Operator Systems 


In this chapter, we investigate the least squares problem of the following coupled 
linear operator matrix equations 


In(X)+ L(Y) = fi, 
{ Lal X) + L(Y) = E», (6.0.1) 


in which Ljj,i,j= 1,2. Denotes a real linear operator and X, Y € €""", E; € 
©*1 i= 1,2. Obviously, the matrix equations (6.0.1) includes the general matrix 
equations 


3 AimXBim + > CyXDg+ > Gi X” His 


m=1 


+ 3 GnY'Han+ X MaYNg= Ep i= 1,2. 
= i=1" 


as special case. So this chapter aims to propose the least squares iterative solution of 
coupled linear operator matrix equations and generalize the results of the paper in), 
In this chapter, we mainly consider the following two problems. 


Problem 6.1. For given E; € €’*",i = 1,2; find X*, Y* € €”*” such that 


a Ol ee | 
| a + Loo(¥*) — By} |= min. (6.0.2) 


Problem 6.2. Let G, denote the solution set of problem 6.1, for given 
Xo, Yo € €”"", find the matrix X € S,, such that 


X — Xol = min||X — X Ý — Yol = min || Y — Yoll. 6.0.3 
| oll al oll, Il oll min || oll (6.0.3) 


DOI: 10.1051/978-2-7598-3102-9.c006 
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6.1 Some Useful Lemmas 


Two matrices X and Y are said to be orthogonal if (X, Y) = 0. For a linear operator 
Land matrices B, X with appropriate dimension, a well-known property of the inner 
product is (L(X), B} = (X, L*(B)), in which the symbol L* is the conjugate operator 
of L. 


Lemma 6.1. Let U be an inner product space, V be a subspace of U, and V+ be 


the orthogonal complement subspace of V. Given w € U, if there exists a wọ € V 
such that ||w— vol] < ||w — || holds for any v € V, then v is unique and up € V is 
the unique minimization vector in V if and only if (w— vo) L V, i.e.(w— v) € V+. 
Lemma 6.2. If we let &;= E;— Ba — Lol Ý), i=1,2 be the residual of 
equations (6.0.1) corresponding to the matrices X,Y € C™*”, then the matrices 
X and Y are the least squares solutions of equation (6.0.1) if 


E(k) =0, 14(2)=0, i=1,2. (6.1.1) 


Proof. Firstly, the linear subspace can be defined asW; = {F;|F; = La(X)+ 
Lo(Y)}, i=1,2 with F; €e ©% and Xe€C"*". Next, if we suppose that 
F, = La(X)+Le(Y),i=1,2, then we have F; € Wi,i=1,2. Thus, for any 
matrices F; € W;, i = 1,2, we have 


(E; — Fi, Fi) = (E; — La (X) — Le( Y), La (X) + Lal Y)) 
= (Ri, La(X) + L(Y )) 
= (Ri, Lal X)) + (Ri, Lol Y)) 
= (Li(Ri), X) + (Lelki), Y) 


Therefore, let (L (Ri), L*,(Ri)) = 0,i=1,2, then we have (E; — F;, Fi) = 0, i = 
1,2. According to lemma 6.1, we can get (E; — F;) € WŁ, i= 1,2. So matrix X is 
the least squares solution of equations (6.0.1). o 
Lemma 6.3. Supposed that (X, Y) be the solutions of problem 6.1, then any solu- 
tions (X, Y) of problem 6.1 can be characterized by (X + Z, Ý + Z) in which matrix 
ZEC"*” satisfies 


La(Z)+Le(Z)=0, i=1,2. (6.1.2) 


Proof. For any solution (x ; Y) of problem 6.1, if the matrix defined as Z = X — X, 
then we have X = Š + Z. From lemma 6.2, we have 
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|| Ea(X) + La(¥) — Bil’ 
(X) + Ln(¥) - Bill 
(Z+ 2)+ bal ¥+ 2) Bi 
a(Z) + Lia(Z) — Rill 
( 
( 


2 A 

|? + || Rill, — 2(Li(Z) + LelZ), Bi) 
PA) fede EVA 

I? + || Rill — 2(Z, Ea Ci) + oR) 


2 
= [Rill - 


Thus, we complete the proof of the conclusion. o 


6.2 MCGLS Iterative Algorithm and Convergence 
Analysis 


In this section, we first present a CGLS-M iterative algorithm, then we give some 
basic properties of the presented CGLS-M or MCGLS iterative algorithm. At the 
end of this section, we put the answer to find the least Frobenius norm solution of 
problem 6.1. 


Algorithm 6.1 


Step 1. Input complex matrices EF; € C?“!,i=1,2 and initial matrices X(1), 
Y(1) € or’; 
Step 2. Compute 


wa 


(1) 
i(1) = Ly (Ri(1)) + a(R) 
(1) 


Step 3. For k = 1,2,3,... repeat the following, if || Ri (k)|| + || Ro(‘)|| = 0, then stop 
and X(k), Y(k) are the solutions of equations (6.0.1), break; 

else if || Ri(k)|| + ||R2(k) | 71(k)|| + || P2(k)|| = 0, then stop and 
X(k), Y(k) are the solutions of problem 6.1, break; 

else k:= k+ 1; 
Step 4. Compute 


© 
— 
so 
— 
II 


La(Pi(k)) + LolPi(k)), i= 1,2, 
5(K) = IEA HRI, 
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X(k+1) = X(k) + 5 0(k)(Pi(k) + P2(k)), 


ee N 


Y(k+1) = ¥(k) + Z) (Pi (k) + P2(8)), 
Ri(k+1) = Ri(k) — Ò(k)Q:(k), i= 1,2, 
Ti(k+1) = Li (R(k+1))4+ L(Ri(k+1)) 
= Ti(k) — 3(K)(Lh,(Q,(k) + L5(Qi(k))), i= 1,2, 


y(k+1) = || Tik +D)? + || Po(k+ DIP, 
Ak) = y(k + 1)/7(k), 
Pi(k+1) = Ti(k+1) + A(k)Pi(k), i= 1,2; 


Step 5. Go to step 3. 


In the following, we give some basic properties of algorithm 6.1. 


Lemma 6.4. If there exists a positive number r, such that ||T;(u)|| 40 and 
||Q,(u)|| 4 0,¢=1,2,Vu=1,2,...,r, then the the sequences T;(k), Pi(k) and 
Q,(k),i= 1,2 generated by algorithm 6.1 satisfy the following statement, for 
u, w = 1,2,...,r and u £ w. 


d (Ti(u), Ti(w)) = 0, 2 (Qi(u), Qi(w)) =0, 2 (Pi), Pi(w)) = 0. (6.2.1) 


t 


i i 


Proof. Step 1: The conclusion will be proved by induction. Because of commutation 
of the real inner product, it is enough to prove three statements for 1<u<w<r. 
For u = 1, w = 2, from algorithm 6.1, we have the following relation 


å y(n, TO — 8(1)(Lh(Qi(1)) + Lig Q(1)))) 

n 3 TOP-30) P a(r) + La(Ti(1)), Q(0)) 
- J TH = 81) (ba Pi) + Lal Pa), PD) 
= DITO - 8) P14), Q0) = 0, 
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ll 
Me» 
oo 
z 
= 
T 
= 
` 
R 
S 


ll 
fan 


AAI Qi i Ea 


II 
Ma 


e 
5 
= 
D 
© 
| 
a 
"E 
3 
© 


ADIDI -ZTO - T0, T) =0, 


II 


i 
= 


and 


Step 2: Thus, for u< w< r if we let 


2 2 


SNT), T(w)) =0, Ql), Qi(w)) =0, SY (Pilu), Pi(w)) = 0. 


i=1 i=1 i=1 


= Y(Ti(u), Ti(w) — ò(w) (La (Q:(w)) + Lio( Qi(w)))) 
= —0(w) Y(Ti(u), Li, (Qi(w)) + Lin(Qi(w))) 


i= 


2 


= —ô(w) X` (La(Ti(u)) + Le( Ti(u)), Q;(w)) 


i= 


= —ô(w) (La (Pilu) — A(u — 1)P;(u — 1)) 


+ La(Pi(u) — A(u— 1)Pi(u— 1), Q;(w)) 
= —ò(w) X> (Q:(u) — A(u— 1) Qi(u— 1), Qi(w)) = 0, 


i= 
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= d(Qi(w), La(Ti(w+1) + A(w) Pi(w)) + Lie( Ti(w +1) + 2(w) Pi(w))) 


= S (Qu), La(Ti(w+1)) + Lol(Ti(w+1))+4(w)Q;(w)) 


= -gg Do (Rw+ 1) — Ril), La(Ti(w+1))+ La(Ti(w +1) 
= — gg DoE Rw 1) — Ri(u)) + By (Ru 1) — RC), Twt 1) 
2 a: $ (Tilu 1) — Tilu), Ti(w+1)) =0; 


For u = w, we also obtain the following relation 


2 
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-YIT lia ô(w) X (Li Ti(w)), Qi(w)) 
= =e || T(w)||? — 5(w) > (Lil Pi(w) — A(w — 1) Pi(w— 1), Qi(w)) 
-DIT j= 5(w) X (Qi(w) — Aw- 1) Q,(w — 1), Qi(w)) = 0, 


S (Qw), Q;(w+ 1)) 


> AQi(w), La(Ti(w+ 1) + Aw) Pi(w)) + Lal Ti(w+ 1) + Aw) Pi(w))) 


=2 (0 (w), La(Ti(w+ 1) + Li(Ti(wt 1) + A(w) Q;(w))) 
2, (w)|| Q,(w) |? — say (w+1) — Ri(w), La(Ti(w+1)) + Li Ti(w +1))) 


= X Aw) Qi(w)||? - A i(w+ 1) — Ri(w)) 


iE »(Ri(w+1) — Se et 1)) 


= PAON - sas s(w+1) ~ Ti(w), Ti(w +1) 
= Aww)? -LI (w+1 
Y(Pilw), Tw 1)) 


= X (Piw), Ti(w) — 5(w)(Li,(Qi(w)) + LCR (w)))) 


=) (T ) + A(w — 1)Ti(w-— 1) + A(w — 1)A(w — 2) T;(w-— 2) 
Pa + (w= 1). A)T), Tw) 
—d(w) X (Pi(w), £i,(Qi(w)) + Lin(Qi(w))) 


l 
2 


| T(w)||? — 6(w) X (La(Pi(w)) + Li(P;(w)), Qi(w)) = 0. 


i=1 


1 4 


Thus, we complete the proof of the conclusion. 
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Lemma 6.5. In algorithm 6.1, it is assumed that there exists a positive number | 
such that 6(1) = 0 or 6(1) = œ, then (X(1), Y(J)) are the solutions of problem 6.1. 


Proof. Now, it is assumed that ô(1) = 0, then 552; || 7;(1)||? = 0. Let 5(2) = 00, then 
we obtain X52 || Q,(J)||’? = 0. This contradicts 


LITO? 


= DPD, THD) = X PO, La (Ri(D) + LCR) = 0. 


i=l i=1 
In this way, for 6(1) = 0 or ô(l) = co we have 
T,()) = (RD) + L,(Ro()) =0, i=1,2. 


On this occasion, it follows from lemma 6.2 that (X(1), Y (1)) are the solutions of 
problem 6.1. Thus, we complete the proof of this lemma. o 


Theorem 6.1. Supposed that coupled matrix equations (6.0.1) are consistent, then 
by using algorithm 6.1 the solution (X*, Y*) of problem 6.1 can be obtained for any 
arbitrary initial matrix pair (X(1), Y(0). 

Proof. For the sake of lemma 6.4, the sequence set generated by algorithm 6.1 
(Tili), Ta(j)), j = 1,2,3,..., 52 2m; X ni; is an orthogonal basis of the real inner 
product space €™*" x €™*" with dimension $57; 2m; x ni. Under this circum- 
stance, we have $`% | Ti(® a 2mini + | 
(XŒ 2min; +1), YL, 2m;n;+1)) are the solutions of problem 6.1 in the 
absence of roundoff errors. O 


= 0. In this case, we can conclude that 


Theorem 6.2. If we choose the initial matrix as L} (F(1)) + h (F(1)), i= 1,2, in 
which F(1) € C”*" is an arbitrary complex matrix, or especially we choose the 
initial complex matrices X(1) = 0, Y(1) = 0, then the solution (X*, Y*) which are 
generated by algorithm 6.1 are the least norm solutions of problem 6.1. 


Proof. If we choose the initial matrices of coupled matrix equations as X(1) = 
Dy, (FQ) + £3,(F() and Y(1) = £7,(F(1)) + £5,(F(1), then the matrix sequence 
generated by algorithm 6.1 X(k), Y(k) can be stated as X(k)= 
Dy, (F(k)) + £5,(F(k)) and Y(k) = L),(F(k))+ £5,(F(k)) for a certain complex 
matrix F(k) € €"*", k = 2,3,.... Therefore, we can conclude that it must have a 
complex matrix F*e@"*" such that X* = LO (F*)+ L (F*) and 
Y* = Lj,(£")+ L5,(£"). Hence we assume X,Y be an arbitrary solution of 
problem 6.1, then, according to lemma 6.3, there must be the complex matrix 
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Zee such that X = X*+ Z*, Y = Y*+Z* and Lu(Z*)+ La(Z*)=0, 
Lia(Z*) + La2(Z*) = 0. So we have the following relation 


(X", 2°) = (Ly (F*) + La (E), 2") = (E, Lal) + Loi (2")) = 0, 


and 


(Y*, Z“) = (Lio (F*) + L5 (F*), Z*) = (F*, Tyo (Z*) + In2(Z")) = 0. 
Thus, we have 
Zr* 2 * x * * * m * * * 
XI = X + P = YP HN A, Z = E H > N, 
and 
#12 * * * * * * * * * 
I = Y> + AP = E HE Y, Z = YP H SYP. 


At this time, it is concluded that (X*, Y*) are the least Frobenius norm solutions 
of problem 6.1. So we complete the proof of the conclusion. O 


Next, we will state as the minimization property of the proposed algorithm 6.1 in 
the following. This property shows that algorithm 6.1 converges smoothly. 


Theorem 6.3. Supposed that (X(1), Y(1)) € €”*” be any initial matrices, then we 
have the following conclusion 


Mrs 


2 
Pa (X(b+1)) + Lal ¥(k+1)) = Bill = mind ||La(X) + Le) — i 4= 1,2 
1 Va id 


(6.2.2) 


in which (X(k+1), Y(k+1)) are generated by algorithm 6.1 at the k+ 1-th 
iteration and y, presents an affine subspace which has the following form 


Wr = X(1)+ Y(1) + span((Pi(1), P2(1)), (Pi(2), Po(2)),---, (P1(k), P2(k)). 
(6.2.3) 


Proof. According to equation (6.2.3), for any matrix (X, Y) € Y}, there must exist 
numbers 0), %,...,%, Such that 
k 


X= X(1)+ S>a(Pi(l), P2()), 


=1 
and 
k 
Y = Y(1)+ X a(Pi(i), Pa(2)) 
I=1 
Now if we define a function f with respect to the variable 1, a2,...,%, as 


2 


La (xa) + D PA) +Lo(Y(1)+ Y a1Pi(0) ae 


a 


2 
F (01, 02,---, 0%) = >> 
i=l 
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in which the function f is continuous and differentiable. So from lemma 6.4 we have 


f (01, 2, -- +) Hk) 


2 k 2 k 
= IRI + SOD afl QDI? — 250 SF ag), RA). 


i=1 i=1 il i=1 [=1 


At the same time, if we now consider the problem of minimizing the function 
f(o1, %2,.-., ak), we can obtain 


minf (21, AQy++ +) ot.) 
l 


= mi Lal Le(Y)— Eill, 1=1,2,...,k. 
ia, 1(X) + L(Y) — Ell’, ices 


From this function, the minimum occurs when 


O( 1, O2,..-, Xp) 
Ot) 


=0 for 1=1,2,...,k. 


Consequently, we can get 


— wie (Qi), Ra) l 
Di QDI? 


Since algorithm 6.1, we have 
Ril) = Ri) +ô- 1) Qi — 1) +ô- 2) QU — 2) + --- +611) (1). 
Therefore, according to lemma 6.4 we have 


L- Eia (Q), RAD) — Vier (Pi, Lin (Ril) + ERD) 
l 


& = = 


D QOI? Der IQD? 
Eia (Pih), SD) _— Wa (Si) +A- 1P- 1), 8:0) 
Di QI? Da OCI? 
-Eia lS L sep, 
Leal? 
In a similar way, we can prove the case of i = 2. By this means, we complete the 
proof. o 


By theorem 6.1, for any initial matrix, we can conclude that the residual norm of 
the solution generalized by algorithm 6.1 minimizes at the k+ 1— th iteration in the 
affine subspace y}. So we have 
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D ILa +D) + L(Y +D) = E< D LX) + Lal ¥(8) - Bil 
(6.2.4) 


This indicates that the residual norm 54 || Ri(1)||, 5S || Ri(2)||,-... i= 1,2, is 
monotonically decreasing. This shows that algorithm 6.1 can process fast and 
smoothly convergence. 

Now problem 6.2 will be considered. For a given matrix Xo, from problem 6.1 we 
have 


2 
i Lal(X)+ Lal Y)-— Ei 
x. Mea) + Lal Y) ~ Eil 


2 
=a La(X — Xo) + La(Y — Yo) — (E; — La(Xo) — Lin Yo))Il- 
aoa 2 Mla X ~ Xo) + La(Y = Yo) ~ (Bi ~ La (Xo) ~ La ¥o))I 
(6.2.5) 


If we let the set È; = Ei — Li (Xo) = Li2( Yo) and x = X— Xo, Y =Y- Yo, 
then problem 6.2 is equivalent to find the least Frobenius norm solution (X}, Y7) of 


min 3 Zac 


a(X)+ Le(Y) — È; 
X, yee” 4 


(6.2.6) 


with the initial matrix X(1) = L4 (F) + (F), YQ) = Li, (F) + L3,(F), in which 
F € C™*" is an arbitrary matrix, or especially X(1) = 0, Y(1) = 0. Therefore, we 
can state the solutions || X — Xol] = minxeg,||X — Xol| and 


Y — Yo|| = min||/Y - Y 
|l oll min || oll; 
of problem 6.2 as 
X=X +X, (6.2.7) 


and 


Y=Y'+Yp. (6.2.8) 


Thus, it is concluded that the solution of problem 6.2 can be obtained through 
the solution of problem 6.1. 


6.3 Numerical Examples 


In this section, we give two numerical examples to check our proposed CGLS-M 
iterative algorithm. The first example proves our proposed iterative algorithm is 
better than the existing LSQR iterative algorithm. The second example shows 
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that our presented iterative algorithm is also effective for any random coefficient 


matrices. 


Example 6.1. Solve the least Frobenius norm solution of the following coupled 


matrix equations 


in which the coefficient matrices are 


4+ 32 


A, XB, + Cı X Dı +E X" F = Mı, 
AX Bə + CXT D = Mo, 


a eee a i ; 3 -2i 4+6i 
A= 2 l © |,B=[(9+8i 4-6i 11 
5— 6i 2+13i 2i i 2i 9i 12 
1 12 10 9i 
i a ce. i -i i 6+8i 
C= s a: ‘ > | D=ļ|4i 19 0 
1—8i 11—9i 21 1 23 26-45 gi 
9-8i 1 i 8i anc 
3 15 1 2+i 9—i 15 2+i 
galt 1428 pea Bta Ita i 
2 (18 21 i 2 Ms 21 i pP 
8i 21 i 8-3 21 —i 8-i 
=i 8 1 2i eal 
: 9 1-—5i 2i 
Ap |) 4 A-3 12 UM | a[i 2+3 12), 
78 11 2 i TE 
9-8i 1l -8i 
13 5 i 13 5 246% 
B 7T 1+23i 1—i tS 0 1 
m= | gjar a a P=] 9 an i 
8—i 2-61 8-i a 
9323447571 11447415154 477441172i 
m, = | 543+11632i 885+ 10010; —423 + 2254: 
1 | 17415 +7013i 22836439367 4649+4863i |’ 
5119 — 1418; 9271 —8442i 6220 — 289i 


(6.3.1) 
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8953 + 28352 8019 — 2492 4094 + 3392 
19013 + 49427 6635 — 34742 8742 — 3897 
33450 + 60342 18057 +3909; 26325 + 12702 
15116 — 26582 9423 +3431 8147 — 29562 


M = 


By some computation, we can obtain that the coupled matrix equation (6.3.1) 
are consistent and have the solution 


3i 21+% 0 


62 9 8 — 91 
a 11-1 4 2— 91 
2— 31 4 12 


Here, if the initial matrix X; = ones(4,3) can be chosen, applying algorithm 6.1 
the iterative least square solution can be solved as 


2.99992 21.0000 + 0.9999: 0.0000 
X(243) = 5.99992 l 9.0000 8.0000 — 8.99994 
11.0000 — 0.9999: 3.9999 1.9999 — 9.0000: 

1.9999 — 2.99992 3.9999 11.9999 


The residual and relative error of coupled matrix equation (6.3.1) are showed in 
figures 6.3.1 and 6.3.2, in which 


r; = logo / || Mi — GIP? + ||M> — HIP, 


where G = A, X(k)B,+ C,X(k)D, + E,X(k)"F,, H = A,X(k)Bo+ C2X(k)" Dy 
and 


| X(k) - xII 

err(k) x . 

Remark 1. It is followed from figures 6.3.1 and 6.3.2 that the residual and the 
relative error of the solution to coupled matrix equation (6.3.1) are reduced with the 
addition of an iterative number. By this result, we can see the iterative solution of 
coupled matrix equations converges to the exact solution. Furthermore, with the 
addition of an iterative number, it is also shown that the residual and the relative 
error of the LSQR-M iterative algorithm of coupled matrix equations are not varied. 
At the same time, it is proved that the residual and the relative error of our iterative 
algorithm are smaller than those of the LSQR-M iterative algorithm. Therefore, our 
proposed method (MCGLS iterative algorithm) is an effective and great algorithm. 


Example 6.2. Solve the least Frobenius norm solution of the following coupled 
matrix equations 


(6.3.2) 


A, XB, T Cı XD, +E, YF; = Mı, 
A2XBə T C2 X Də +E YF = Mo, 
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Fic. 6.3.1 — The residual of solution for example 6.1. 
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Fic. 6.3.2 — The relative error of solution for example 6.1. 
where 
A, = rand(6,7) + ix rand(6,7), Bı = rand(5,4) + i * rand(5, 4), 


Cı = rand(6, 7) + ix rand(6,7), Dı = rand(5, 4) + i rand(5, 4), 
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Ay = rand(6,7) + ix rand(6,7), Bo =rand(5, 


C2 = rand(6,7) + ix rand(6,7), D2 = rand(5, 


FE = rand(6,7) + lix rand(6,7), F= rand(5 


Ey = rand(6,7) + 1i * rand(6,7), Fy = rand(5, 


—6.6343 + 29.70042 —11.6641 + 26.6410: 
—4.3583 + 20.20727 —9.0990 + 16.9895: 
—9.0665 + 24.70642 —13.0560 + 22.15592 


a —8.0747 + 19.28791 —10.7742 + 17.5695 
—8.7840 + 20.37742 —12.7093 + 17.5514 

—5.7835 + 23.3203; —10.7752 + 22.2704 

—14.5118 + 26.60632 —11.6376 + 32.5976: 
—11.5972 + 28.1350; —5.4724+ 34.2821 

M = —15.8140+ 18.59142 —11.6417 + 26.04882 
—14.1510+ 21.0841; —8.8672 + 27.94732 


—13.5717+ 21.01447 —9.6517 + 27.6175 
—17.3981 + 23.29461 —14.0598 + 31.9706: 


4) + ix rand(5,4), 


4) +i rand(5, 4), 


,4)+ ix rand(5,4), 


A) + ix rand(5, 4), 


4.7953 + 26.28781 
—2.7453 + 17.6718: 
—7.2720 + 21.8593% 
—5.4971 + 17.62452 
—6.5985 + 18.39414 
—4.3001 + 21.01052 


—3.4258 + 26.02802 
—0.3306 + 16.9502: 
—6.8525 + 21.31052 
—5.7757 + 15.89732 |’ 
—6.6394 + 18.9002 
—4.1352 + 19.7401: 


—10.4847 + 21.05462 
—7.6472 + 22.99154 
—12.4484 + 15.46417 
—10.8980 + 18.41002 
—10.3281 + 16.0999; 
—13.7004 + 19.74972 


—11.7599 + 27.9033 
—7.8647 + 28.89841 
—14.1854 + 23.0876: 
—11.0275 + 25.80174 
—10.1937 + 22.74802 
—15.4352 + 26.8111: 
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By some computation, we can obtain that the coupled matrix equations (6.3.2) 


are consistent and have the solution 
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0.4417 + 0.28807 0.1017+ 0.60792 0.5054 + 0.79902 
0.0132 + 0.69257 0.9954 + 0.74132 0.7614 + 0.73432 
0.8972 + 0.55677 + 0.33214+0.10482 0.6311 + 0.05132 
X = | 0.1967 + 0.39652 0.2973 +0.1279: 0.0899 + 0.07291 
0.0934 + 0.06167 0.0620 + 0.54952 0.0809 + 0.08852 
0.3074 + 0.78027 0.2982 + 0.48522 0.7772 + 0.79842 
0.4561 + 0.33761 0.0464 + 0.89052 0.9051 + 0.94302 


0.5338 + 0.68377 0.0485 + 0.65382 
0.1092 + 0.13217 0.6679 + 0.74912 
0.8258 + 0.72277 0.6035 + 0.58322 
0.3381 + 0.1104; 0.52614 0.74002 |, 
0.2940 +0.11751 0.7297 + 0.23487 
0.7463 + 0.64077 0.7073 + 0.73502 
0.0103 + 0.32887 0.7814 + 0.97062 


and 


0.8669 + 0.65557 + 0.3677+0.76902 0.2290 + 0.60992 
0.0862 + 0.10987 0.2060+ 0.39602 0.6419 + 0.05942 
0.3664 + 0.93387 0.0867+ 0.27297 0.4845 + 0.31582 
Y = | 0.8692+4+0.18752 0.7719+0.03722 0.1518+ 0.77271 
0.6850 + 0.26627 0.2057+ 0.67332 0.7819 + 0.69642 
0.5979 + 0.79787 0.3883 + 0.42962 0.1006 + 0.12532 
0.7894 + 0.48767 0.5518+0.45172 0.2941 + 0.13022 


0.2374 + 0.09247 0.2916 + 0.63182 
0.5309 + 0.00782 0.6035 + 0.12652 
0.0915 + 0.42317 0.9644 + 0.13432 
0.4053 + 0.65567 0.4325 + 0.09862 
0.1048 + 0.72297 0.6948 + 0.14202 
0.1123 + 0.5312; 0.7581 + 0.16832 
0.7844 + 0.10887 0.4326 + 0.19622 


According to algorithm 6.1, if we let the initial matrix X(1) = ones(7,5), 
Y(1) = ones(7,5), the iterative solution converge to the exact solution and we can 
obtain figure 6.3.3. The corresponding residual is 


r(324) = 9.5931 x 1076, 


where 


re = logo Ma — MiP + M> — MYIP, 


Mi, = A, X(k) By — Cı X(k)Dı — E,Y(k)F1, 
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2 T T T 
¥ X(1)=ones(7,5),Y(1)=0ones(7,5) 
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Fic. 6.3.3 — The residual of solution for example 6.2. 


and 


Mi, = A2 X(k)B> — C2X(k) Dz — Ez Y (k) F>. 


Remark 2. From figure 6.3.3, for any random coefficient matrices, it’s shown that 
the residual is becoming smaller and smaller with the addition of an iterative 
number, and the iterative solution converges to the exact solution. In addition, it is 
also proved that our proposed MCGLS iterative algorithm is a magnificent 
algorithm. 


6.4 Conclusions 


In this chapter, the MCGLS iterative algorithm is constructed for solving the least 
Frobenius norm solution to a coupled matrix equations. By use of this proposed 
iterative algorithm, on the one hand, for any initial matrix pair (X(1), Y(1)), the 
least Frobenius norm solution can be obtained. On the other hand, if a matrix pair 
(Xo, Yo) are given, the optimal approximation solution (X, Y) can be derived by 
first finding the least Frobenius norm solution of a new corresponding coupled 
matrix equations. It is worth noting that our proposed iterative algorithm is suitable 
for a family of coupled matrix equations whose coefficient matrices are random 
matrices. In addition, the numerical example shows that our proposed MCGLS 
iterative algorithm is better than the existing LSQR iterative algorithm. 


Chapter 7 


Explicit Solutions to the Matrix 
Equation X — AXB = CY + R 


In this chapter, we are concerned with the explicit solutions to the nonhomogeneous 
Yakubovich matrix equation 


X-— AXB= CY +R, (7.0.1) 


where A € R”””, Be R?*? and C € R"*" are given real matrices, X € R"*? and 
Y € R”? are the matrices to be determined. Obviously, the well known Yakubovich 
matrix equation (7.0.2) and generalized Sylvester matrix equation (7.0.3) 


X- AXB= CY, (7.0.2) 
and 
AX — EXF = CY, (7.0.3) 


are the special cases of the nonhomogeneous Yakubovich matrix equation. 


7.1 Solutions to the Real Matrix Equation 
X—AXB=CY+R 
In this section, we provide the closed-form solutions of the nonhomogeneous 


Yakubivich matrix equation (7.0.1) by Smith normal form reduction and polyno- 
mial matrix. In order to obtain the result, we need the following lemma. 


Lemma 7.1. Given matrices A € R”*”, Be R?*? and C € R"*", suppose that 
{s|det([, — sA) = 0}N4(B)= ġ. Then there exist polynomial matrices 
L(s) € R”””[s], H(s) € R”””[s], and polynomial A(s) € R[s] such that 


(In — A) L(s) — CH(s) = A(s)In, (7.1.1) 
in which A(s) 4 0, for any s € A(B). 


DOI: 10.1051/978-2-7598-3102-9.c007 
© Science Press, EDP Sciences, 2023 


116 Solutions to Linear Matrix Equations and Their Applications 


Proof. Assume P(s) € R”*”[s] and Q(s) € ROTO*O+ [5 be two uniocular poly- 
nomial matrices. Now we transform [J,, — sA — C] into its Smith normal form 


P(s)[fn— sA — C]Q(s) = [diag di(s) 0), (7.1.2) 


where dj_1(s)|di(s) € R[s], i € I[2,n]. Since the relation {s|det(Z, — sA) = 
0}N4(B) = p holds, then d;(y) Æ 0,i € I[1, n], for any y € A(B). Partition Q(s) 
into [Q1 (8s), Qo(s)] with Q,(s) € R™*+"*"[s]. It follows from (7.1.2) that 


P(s)[In— sA — C]Qy(s) = diag”. di() 
dn 
1 d; 


dn(s) 
di(s) 
Thus, one can choose A(s) = da(s) and 


E] = COS ADN PCS) 


to satisfy the relation (7.1.1). o 


=N 

w 
Wa 
l 


<> P(s)|In — sA — ClQ,(s)diag?_ 


s 
— 
WD 


<> [I,-—sA — C] COS 


In the following, we are going to provide a closed-form solution of the nonho- 
mogeneous Yakubovich matrix equation (7.0.1) by the above lemma. 
Theorem 7.1. Given matrices A € R””*”, Be R*?, Ce R"*" and RE R"?, sup- 
pose that polynomial matrices L(s) = JD} List € R”™”[s] and H(s) = Yio Hist € 
Rs], and polynomial A(s) = ¥7!_ Ais’ € R[s] satisfy (7.1.1) with A(s) 4 0, for 
any s € A(B). Further, let the relation {s|det(/, — sA) = 0} 4(B) = ¢ hold, and 
F1,,a)(8) = det(In — sA) = ons" + +++ +015+00,%0 =1, 
adj(In = sA) = Rais +e + Rıs+ Ro. 


Then all the solutions to the nonhomogeneous Yakubovich matrix equa- 
tion (7.0.1) can be stated as 


n—1 . t-1 . 
X= 3 R,CZB + 2 LiRJA( B)" B’, 


; . (7.1.3) 
Y = Zfu,a(B)+ >, HiRJA(B)]? B'. 


where Z € R”? is an arbitrary chosen free parameter matrix. 


Proof. We first show that the matrices X and Y given in (7.1.3) are solutions of the 
matrix equation (7.0.1). A direct calculation gives 
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X — AXB 
= 3 R,CZB' + 3 LiR[A(B) B’ — A D R,CZB'B— A L,R{A(B)|"' B'B 
7=0 = a 
_S pons a, cop"). Ñ> L:RJA(B -AÑ LRA es 


7=0 i=0 i=0 
n—1 


= RoCZ+ X (R; — AR 1) CZB' — AR,_, CZB” + Ly R[A(B)|* 


i—i 


+ (Li = ALi) R[A(B)|"'B' = AL R[A(B)] "B. 


ll 
pi 


(7.1.4) 
According to (I, — sA)adj(I, — sA) = I,det(I, — sA), it is easy to obtain 
Ro = %Ln, 
R;-AR-1= ln, ic I[1,n—1], (7.1.5) 
—ARn-1 = Ont. 


So we have 
n-1 A n r 
Ro CZ + > (Ri im ARj-1) CZB' = ARn-1 CZB" = CZy. a, B’ = CZfır, a) (B). 
i=1 i=0 
(7.1.6) 


Moreover, comparing the power of s in (7.1.1) yields 


Lo = CHo + Aon, 
Li— ALi = CH, HAG, icIU, t1), (7.1.7) 
—AL;ı = CHi + A;In. 


With these relations, we can derive 


LoRJA(B)] + + (Li — ALi) RJA(B)] t B! — AL,_, R[A(B)|' Bt 


= (CHo + Aol n)R[A(B)]* + S CH; + A;In)R[A(B)] 7" B' 


+ (CH, + A;I„)R[A(B)' Bt 


(7.1.8) 


i=0 
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Substituting (7.1.6) and (7.1.8) into (7.1.4), we have 


t 
X — AXB = CZfu, a (B) + X CHiRJA(B)] Bi + R 
i=0 


= o( a, 4)(B) + 5 nwa e) +R 


i=0 


=CY+R. 


Therefore, the matrices X and Y given in (7.1.3) satisfy the matrix 
equation (7.0.1). 

Next, the completeness of solution (7.1.3) will be proved. In relation (7.1.3), the 
free parameter matrix Z is included, which is an r x p matrix. So the parametric 
matrix Z has rp parameters. In this case, solution (7.1.3) has rp parameters. Putting 
vec(-) on both sides of expression (X, Y) in (7.1.3), we have 


bee eal 


Denote the set 

= X vec( X vec(Z z 

RS {| J | bee] 7 v [ret | ze "n i 
and according to the above section of the proof in theorem 7.1, we have RCR. 
Obviously, R = R (R denote the solution set of matrix equation (7.0.1)) if and only 
if dim(R) = rp. Since dim(Z) = rp, dim(R) = rp if and only if rank(¥) = rp. 
Obviously, rank(¥) = rp if Mə is nonsingular. Mə, is nonsingular if and only if 
fa, a(B) is a nonsingular matrix. 

If we assume fa, a(s) = det(I, — sA) = Ans” + +++ +0185 + %0, %0 = 1, and 
adj(In — sA) = Rn-1s” + --- + Rıs+ Ro, because of {s|det(I„— s4) = 0}N 
À(B) = >, the matrix fq, a) (B) = &nB” + --- +01 B+ aol, is a nonsingular matrix. 
Therefore, the mapping Z —> (X, Y) defined by (7.1.3) is injective. It is showed the 
completeness of solution (7.1.3). Thus the proof has been completed. o 
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Remark 1. Init, in order to obtain the solution, it demands the matrices D;, i = 
1,2,...,w. satisfying the unknown matrices X = BDọ+ ABD +- + 
AY BDy-1 + AY BDy and XY = R. In order to make the matrices D;, i= 
1,2,...,w. easier, it expect that the matrices X and Y have low dimension. In this 
case, (X, Y) is a pair of full rank factorization of R. But in the present chapter, it has 
no this limit. 

From theorem 7.1, it is easy to know that under the condition of { s|det(I, — sA) 
= 0}()A(B) = ¢ all the solutions of the matrix equation (7.0.2) can be explicitly 
given by 


X= D> RCZB', 


2. (7.1.9) 
Y = Zfv1,,4)(B). 


Moreover, by theorem 7.1 it is obvious that a special solution of the matrix 
equation (7.0.1) is 


Regarding the solution of œ; i€ I[0,n], and R;, i€ I[0,n— 1], the so-called 
generalized Leverrier algorithm!’ can be stated as the following relation: 


Ri = AR + &iln, i € Ifl, n — 1], Rọo= l, 


ic Ifl, n]. (7.1.10) 
= trace(AR;-1) 


i 


For relative lower-order cases, the Smith norm form reduction can be realized by 
applying elementary polynomial matrix transformation. For high-order cases, the 
Maple function “smith” can be readily employed. 

Similarly to the reference!!! we have the following equivalent form of the pre- 


sented solution (7.1.3). For this solution, a lemma is necessary. The idea of the proof 
of this lemma is motivated byl, 


Lemma 7.2. Suppose L;,i € J[0,t— 1], and H;, A;, i € I[0, t], be the coefficients of 
L(s), H(s) and A(s), respectively. Then the relation (7.1.1) holds if and only if 
H;, Aj, i € I[0, t], satisfy 


t 


5 "(A)" CH; = ray (7.1.11) 
i=0 


i=0 
and Li, i € I[0,t — 1], satisfy 
[Lo Ly +++ Ly-1] = Ctr,(A, C)S;(H(s)) + Ctr,(A, In) S:(A(s) In). (7.1.12) 
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Proof. By theorem 7.1 we can know that L;, i€ I/0,t—1], and H;, A;, i € J[0, t] 
satisfy (7.1.1) if and only if they satisfy (7.1.7). Therefore, we only need to show that 
the relation (7.1.7) is equivalent to the relations (7.1.11) and (7.1.12). 

From the recursive relation (7.1.7), a direct calculation gives 


Lo = CHo T Aolns 
Li = CH, + ACH) + A1 In + AAogln, 


ae (7.1.13) 
Lya = CH + ACH, 9+ «+ + AT CH 
head deste ave eG Ar 
and 
0= CH,+ ACH +- +A CHo +A;I+ Ap 1A+4+ ++» + Ap A’. (7.1.14) 


The relation (7.1.14) is exactly (7.1.11). Rewriting (7.1.14) in a matrix form one 
can derive (7.1.12). In this case, it is shown that (7.1.7) implies (7.1.11) and (7.1.12). 
In addition, it follows from the relation (7.1.12) that 


AL ı = ACH 4 + ACH o+ -+ ACH EA At Arg oe AA. 


Combining this relation with (7.1.11) we can obtain the last expression of (7.1.7). 
For i € I[1,t— 1], according to (7.1.12) one has 


ALi + CH; + Ailn 
i—1 
= A( X DATH CH; + AA) + CHi + Ailn 
j=0 
i—1 


=) [A CH; + AAI] + CH; + Aln 


[At D-1 CH; + AAC tD- 


This is just the second expression of (7.1.7). The first expression of (7.1.7) is 
obvious. Thus the relation (7.1.11) and (7.1.12) imply the relation (7.1.7). So the 
proof is completed. O 


In the following, the presented closed-form solution to the matrix equa- 
tion (7.0.1) is in an extremely neat form represented by the controllability matrix 
associated with the matrices A and C, the observability matrix associated with B 
and the free parameter matrix Z, and the symmetric operator matrix. This property 
may propose convenience and advantages to the further analysis of the matrix 
equation (7.0.1). 


Theorem 7.2. Given matrices A € ®"*", BE RP*?, CER” and RER"?, 
suppose that {s|det(/, — sA) =0}()A(B) = ¢, and the polynomial matrix 
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H(s) = $` His' € R"*"[s] and polynomial A(s) = S7/_, Ais! € R[s] satisfy (7.1.11) 
and A(s) Æ 0, for any s € A(B). Then all the solutions to the matrix equation (7.0.1) 
can be stated as 

X = Ctrn(A, C)Sn(fz,,4)(8) Lr) Obsn(B, Z) 


+ Ctri( A, C)S:(H(s)I,) Obs:(B, RIA(B)|") 
+ Ctry(A, In) 5i(A(s)In) Obs; ( B, RIA(B)|*), (7.1.15) 


Y = Zfu, (B) + $ HRA(B) P', 


i=0 
where Z is an arbitrary chosen real parameter matrix. 
Proof. According to the relation (7.1.10), we can derive 


Ro = In 
Ry = ailn + A, 
Rə = %2 Ín + a, A+ A’, 


Rn-1 = only T On—9A + ion Ar. 


This relation can be compactly expressed as 
i 
Rey gd a= 1,i= 1,2.. n1. 
k=0 


Therefore, one can obtain 


n—1 n—1 i 
XO RiCZB' =X X wA" OZB'. 


i=0 i=0 k=0 


With these relations, one easily has 
n—-1 
XC RiCZB' = Ctr(A, C) Sn(fcz,,a)(8)Ir) Ob8n(B, Z), (7.1.16) 
=0 


It follows from lemma 7.2 that the relation (7.1.1) holds if and only if the relations 
(7.1.11) and (7.1.12) hold. So we have 


= [Lo Ly +++ L4_1]Obs,(B, R[A(B)]') (7.1.17) 
= [Ctr,(A, C)S,(H(s)) + Ctri( A, In) Si(A(s))In] 
x Obs;(B, R[A(B)]~'). 


122 Solutions to Linear Matrix Equations and Their Applications 


Substituting (7.1.16) and (7.1.17) into the expression (7.1.3), gives (7.1.15). The 
proof is completed. O 


Example 7.1. In order to show the efficiency of theorem 7.2, we give an example in 
the form of (7.0.2). We use the following parameter matrices. 


1 4 -3 424 97 2 
A=|1ı 1 0 |,B=[9 6 2ļ|,c=|4 11 10), 
-1 0 1 4 2 1 7 1 -1 


we can check {s|det(I — sA) = 0} N 4(B) = 
By simple computations, it is easy to ne 


fas a(s) = det(I — sA) = 6s — 4s? — 38+1, 


100-3 0 0 -4 0 0 
010 0 -3 0 0 -4 0 
0010 0 -3 0 0 -4 
000 1 0 0 -3 0 0 
Ss(fu,ayy 3)=]0 00 0 1 0 0 -3 Of, 
0000 01 0 0 -3 
000 0 0 0 1 0 0 
000 0 0 0 0 1 0 
000 0 0 0 0 0 1 


7 1 1 2 -6 -3 -6 —54 —48 


9 7 2 4 48 45 62 138 102 
Ctr3(A,C)= [4 11 10 13 18 12 17 66 57 |, 


—1.2808 1.8309 —3.0644 
4.0899 —5.9867 10.1498 
—3.8419 5.7190 —9.7834 
—0.9027 2.2950 —4.5257 
Obs3(B,Z) = | 3.0786 —7.4407 14.5360 
—3.0300 7.0635 —13.7130 
—1.0587 2.9131 —3.5466 
3.4920 —9.4151 11.9690 
—3.4004 8.8951 —11.7060 


Choose Z = 


as 


4.0899 —5.9867 10.1498 , so from theorem 7.2 we have 


—1.2808 1.8309 —3.0644 
—3.8419 5.7190 —9.7834 
1 
2 
1 


52.4426 32.9016 12.9672 
7 i , Y = | —156.4645 —99.4153 —38.6940 |. 
-1 2 136.6339 87.8962 33.0765 
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When the matrix triple (A, In, C) is R—controllable, that is rank|I„ — sA — C] = 
n, for any s € R, the approach of theorem 7.2 can be readily employed to solve the 
matrix equation (7.0.1) without use of Smith normal form reduction. This is sum- 
marized as the following corollary. 


Corollary 7.1. Given matrices A € R”*”, BE R?*?, CER” and RER™?, 
suppose that { s|det(I„ — sA) = 0}()A(B) = ¢ and (A, In, C) is R—controllable. Let 
the polynomial matrix H(s) = )>i_)His' € R'*"[s] satisfy 
t 
XC AY CH; = —A’. (7.1.18) 


i=0 
Then all the solutions to the matrix equation (7.0.1) can be characterized by 


X = Ctri( A, C)Sn(fz,,4) (8) Lr) Obsn(B, Z) 


+ [Ctri(A, C)5:(H1(s)) + Cére(A, In)]Obs:(B, R), (7.1.19) 


Y = Zfa, a (B) + L HiRB', 


in which Z is an arbitrary chosen parameter matrix. 

According to theorem 7.2, when (A, In, C) is R—controllable, this corollary can be 
derived if the polynomial A(s) choose to be 1. In this case, the relations [A(B)|~' = In 
and S;(A(s)I,) = I hold, and the matrix equation (7.1.11) transforms into the the 
matrix equation (7.1.18). If we denote Hy = [HF Hi, + Hel. this equation can 
be rewritten as 


Ctri41(A, C) Hy = A". (7.1.20) 
If the number t is sufficiently large, one gives 
rank[Ctr;.1(A, C)| = rank[Ctr;,1(A, C) — A’). (7.1.21) 


Under this condition, the matrices H;, i € [1, t], can be obtained from (7.1.19) by 
using some numerically reliable approaches such as QR decomposition and SVD 
decomposition. Furthermore, the relation S,(A(s)J,) = 0 holds when the polynomial 
A(s) is selected to be s*. Similar to the above argument, it is easy to derive the 
following corollary. 


Corollary 7.2. Let A € R”””, Be R? and C € R”"*", suppose that { s|det(J,, — sA) 

= 0}()4(B) = ¢ and 0 is not included the set 4(B). If the polynomial matrix 
H(s) = Yip His’ € R" [s] satisfy 
t 

dA CH = —In. (7.1.22) 


i=0 
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Then all the solutions to the matrix equation (7.0.1) can be stated as 


X = Ctri( A, C)Sa(fu, a (SMr) Obsn(B, Z) 
+ Ctri( A, C)S;(H(s)) Obs,(B, RB“), 


: (7.1.23) 
Y = Zfu,„a (B) + 2 HRB’, 


where Z is an arbitrary chosen parameter matrix. 


7.2 Parametric Pole Assignment for Descriptor Linear 
Systems by P-D Feedback 


Example 7.2. As an application of the proposed solution, we consider the following 
linear system: 
Er = Az + Bu, (7.2.1) 


where A, E € R””” and Be R”%" are known coefficient matrices. If the following 
state feedback controller 


u = — K, — Kat, (7.2.2) 
is applied to the above system (7.2.1), the closed-loop system becomes 
(E+ CKa)x = (A — CK,)z. (7.2.3) 
Thus, the closed-loop system (7.2.3) is regular if and only if 
det(E + BK4) # 0. (7.2.4) 


In this case, if the closed-loop system is supposed to be regular, the closed-loop 
system (7.2.3) can be rewritten as 


ï= A.t, A,=(E+BK,)'(A—5K,), (7.2.5) 


Given a set of desired closed-loop poles s;, i= 1,2,...,n. The parametric pole 
assignment problem is to determine the matrices Ky and K, such that the 


closed-loop system matrix (E+ BK4) (A -— BK,) has desired eigenvalues and 
eigenstructure, i.e. determine the matrices K4 and K, such that 


K, =(Y — KıXB)X +, (7.2.6) 
and eigenstructure 
o(A.) = o((E+ BK) (A — BK,)) = {s i= 1,2,.. n}, (727) 


Note that (7.2.7) is satisfied if and only if there exists a nonsingular matrix X and 
a matrix B satisfying o(A,) = o(B) such that 


X|(E+ BK,) (A -— BK,)|X =F, 
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which is equivalent to the generalized Sylvester matrix equation (7.0.3) by setting 
Y = K X+ KıXF. Therefore, the pivotal step in solving the parametric 
pole assignment problem is to solve the generalized Sylvester matrix equa- 
tion (7.0.3). The following lemma shows that the generalized Sylvester matrix 
equation (7.0.3) is the equivalent form of the generalized discrete Sylvester matrix 
equation (7.0.2). 


Lemma 7.3. “'!The generalized Sylvester matrix equation (7.0.3), where 
A, E ER", Be R”, and F € R?*? are known and the matrix pair (E, A) is 
regular, is equivalent to the generalized discrete Sylvester matrix equation (7.0.2) 
with 


M=(yE-—A)'E, N=yI-F, T= (yE-— A'B, 
where y is an arbitrary scalar such that (yE — A) is nonsingular. 


Lemma 7.4. There exists a matrix K4 such that det(E + BK 4) 4 0 holds if and 
only if rank|E B] = n holds. Further, let rank|E B] = n hold and U € R”*”” bea 
nonsingular matrix such that 


_ (Ty, (i 
w- (4). w- (8) 


where I, € RI”, then all the matrix K4 satisfying det(E+BK,) #0 can be 
characterized as 


Kı = 0; (P — E), 
with P € R?” satisfying 
Im( Ef t) ® Im(P?) = R”. 


Generally speaking, if the desired eigenvalue set contains complex numbers, the 
coefficient matrix B is a complex matrix. Thus the existing results involve complex 
arithmetic, for example in?) However, complex arithmetic can be avoided if the 
results of this chapter are used. In order to illustrate our approach to solving the 
generalized discrete Sylvester matrix equation X — AXB = CY with their applica- 
tions on parametric pole assignment for descriptor linear systems. In the following, 
we consider a system in the form of (7.0.3) with the following system matrices 


(borrowed from!!?9:195)), 
100000 a ae a, oe a 
01000 0 | oe ak 1i 
001000 EELE u 

F=1) 9001 0o p47lo0o01 00 P2F7lo 0 
00000 0 ere. E 
100000 1 0000 1 0 0 
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It is obvious that such a system is C-controllable. If we choose y= 1, then 
according to lemma 7.3, we can get the matrices M and N as 


0 -1 0 0 0 O 0 0 
0 0 -1 0 1 =O 0 0 
-l 0 0 0 0 Ọ 1 0 
ae 0 0 0 0 -1 0p n 0 0 
0 0 0 0 0 Ọ =l -1 
-1 1 0 0 0 0 0 0 


The inverse characteristic polynomial of M is 
B(s, Y) = B(s,3) = det(sM — I) = $ +1. 


Therefore, we have 


and 
bL Olg 0hb b 0hb Old 


bL 0hb Ofg h Oly 
bL Olg 0k k 


52(I2, A) = b 0L 0b 
b 0b 
Ig 


We now consider a P-D feedback law in the form of (7.2.1). For select the 
closed-loop eigenvalue set as 


eA) = o(F) = {-1,-1,-2, —2, —1 + i}. 


Thus, the matrix F can be chosen as 


=). 0 0 0 0 0 
6 -1 0 0 0 0 
0 0 -2 0 0 0 
r (0 6 ao Yee e oS 
0 0 0 0 0 1 
0 0 0 0 2 -2 


Under this condition, according to theorem 7.2, a complete parametric solution to 
the generalized discrete Sylvester matrix equation (7.0.2) can be expressed as 


X= Ctre(M, T) S2(I2, A) Obss(Z, N), 
Y =-Z- ZN. 


where Z € R?*® is an arbitrary parametric matrix. In order to guarantee that X is 
nonsingular, we need to have 


(235 — 2226225 + 2226) (222211 — 221212)(— 214223 + 213224) Æ 0. 
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In addition, the matrices U, E1, E2 and I, defined in lemma 7.4 can be expressed as 


100000 100000 
000010 000000 

aa ae eo a L 
~10 00 10 0/’\E/ [0 0001 07}? 8 u1 
010000 01000 0 
000001 10000 0 


Therefore, by lemma 7.4 all the derivative gain matrix Kg can be parameterized as 
Ka = 0}; (P — E) 
= ( Pua P12 P13 Pi P15 Pi6 ) 
Po +1 — py P22 — Pig P23—13 P4 — Pia P25 — Pis P2 — Pic i 


where P € R?*® is a parameter matrix satisfyin, 
ying 
Po6Pi4 — PigPra # 0. 


According to (7.2.5), by specially choosing 
z-{1 9 0 10 0 p-{9 9 0 10 0 
-A0 11011? > \0 00001) 
We can obtain 


g -(¢1 00 100 g= (71H -13 -5 3 8 2 
aa 0 0 a ye Ne" OF. 23 9 -3 -11 8) 


Example 7.3. Consider the following linear system: 
Ex = Az + Bu, (7.2.8) 


where A, E € R”*” and Be R"*" are known coefficient matrices. If the following 
state feedback controller 


u=—K,«x— Każ, (7.2.9) 
is applied to the above system (7.2.8), the closed-loop system becomes 
(E+ BKq)k = (A — BEK,)z, (7.2.10) 


The eigenstructure assignment problem is to determine the matrix K, such that 
the closed-loop system matrix A — BK, has desired eigenvalues and struture, i.e., 
determine the matrix K, such that 


A— BK, = EXFX +, (7.2.11) 


where F is the desired Jordan form of the closed-loop system and X is the 
corresponding eigenvector matrix. If we choose K,X+KyXF=Y, the 
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equation (7.2.11) is equivalent to the generalized Sylvester matrix equation 
AX — EXF = BY. By lemma 7.3, the generalized Sylvester matrix equation AX — 
EXF = BY is equivelent into the Yakubovich matrix equation X — MXN = TY. 
By theorem 7.1, we can obtain the solution to Yakubovich matrix equation 
X— MXN = TY. 


—2 —4 —3 4 3 2 1 2 3 
If we choose A = 1 1 0 ]|,E£E=|9 8 7],F=)0 1 2], B= 
-1 0 1 4 3 2 4 0 1 
9 7 6 
4 3 2 |, wecan check {s|det(I — sA) = 0} N 4(B) = @. If we choose y = 1, by 
0 1 0 
lemma 7.3 we have 


1.4400 1.2800 1.1200 0 —2 -3 
M= | —1.4200 —1.5400 -1.6600 |, N=| 0 0 -2], 


1.0600 1.2200 1.3800 —4 0 0 


—1.8800 —1.2000 —1.3600 
T= | 3.3400 2.6000 2.4800 
—0.6200 —0.8000 —0.6400 


By simple computations, it is easy to obtain fz a(s) =det(J — sM) = 
0.38? — 1.28s+1, 


i 0 0.16 1.28 1.12 
Ro={0 1 0], R= [| -1.42 -2.82 -1.66 J, 
001 1.06 1.22 01 


—106.91 -—38.1915 —106.3752 
Choose Z = | —70.0416 —29.1167  —71.1143 |, so from theorem 7.1 we have 
230.1276 82.4103 228.1911 
3 2 4 —189.3333 —110.6667 —243.3333 
X={1 6 3],Y= | —130.0000 —76.0000 —159.0000 
4 2 1 410.1667 236.3333 520.6667 


7.3 Conclusions 


In this chapter, the solutions to the nonhomogeneous Yakubovich matrix equation 
in the real field are presented by means of Smith’s normal form reduction and 
polynomial matrix. These proposed solutions can provide all the degrees of freedom, 
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which are represented by an arbitrarily chosen parameter matrix Z. All the coeffi- 
cient matrices are not restricted to be in any canonical form. The matrix B explicitly 
appears in the solutions, thus can be unknown a priori. From the discussion in this 
chapter, one can observe that the solutions to the nonhomogeneous Yakubovich 
matrix equation are crucial as the theoretical basis of the development of many 
kinds of other matrix equations, and are deserved further investigation in the future. 
In addition, as the theoretical generalization of the well-known generalized Sylvester 
matrix equation, it may be helpful for future control applications. 


Chapter 8 


Explicit Solutions to the Nonhomogeneous 
Yakubovich-Transpose Matrix Equation 


The well-known Karm-Yakubovich-transpose matrix equation 


X— AX™B= OC, (8.0.1) 


and the general discrete Lyapunov-transpose matrix equation 


X= BX R= CC", (8.0.2) 


are closely related to many problems in conventional linear control system theory, 
such as pole/eigenstructure assignment design, Luenberger-type observer design, 
robust fault detection, and so on. Moreover, the generalized discrete 
Yakubovich-transpose matrix equation 


X—AX'TB=CY, (8.0.3) 


where A € R"*?, BE R”? and C e R"" are the known matrices and X € R™?, 
Y € R™? are the unknown matrices, has important applications in dealing 
with complicated linear systems, such as large-scale systems with interconnections, 
linear systems with certain partitioned structures or extended models and second 
order or higher order linear systems. As a generalization of the above transpose 
matrix equations, the following nonhomogeneous Yakubovich-transpose matrix 
equation 


X — AXTB = CY +R, (8.0.4) 


is considered in this chapter, where A € R”™?, B, R€ R? and C € R"*" are the 
given matrices, and X € R"*?, Y € R”? are the unknown matrices. In the present 
chapter, two methods to obtain the solution to the nonhomogeneous 
Yakubovich-transpose matrix equation are given. Furthermore, the equivalent form 


DOI: 10.1051/978-2-7598-3102-9.c008 
© Science Press, EDP Sciences, 2023 


132 Solutions to Linear Matrix Equations and Their Applications 


of the solution is proposed. One of the solutions is established with the 
controllability matrix, the observability matrix, and symmetric operator matrix. 


8.1 The First Approach 
To obtain the result, we need the following lemma with the aid of Smith normal form 
reduction. 
Lemma 8.1. Given matrices A € R”, BER"? and CE R"*", suppose that 
{s|det(I — sAB*) = 0}N4{BTA} = ġ. Then there exist polynomial matrices 
L(s) € R"*"[s], H(s) € R”””[s], and polynomial A(s) € R[s] such that 

(I — sAB*)L(s) — CH(s) = A(s)In, (8.1.1) 
where A(y) Æ 0, for any y € A(B7 A). 


Proof. Let P(s) € R"*"[s] and Q(s) e R™*"** Is] be two uniocular polynomial 
matrices that transform [[,, — sABT — C] into its Smith normal form, that is, 


P(s)[J, — sAB? — C|Q(s) = |diag’_, di(s) 0 J, (8.1.2) 

with dj;_1(s)|dj(s) € R[s],i € I[2,n]. Since {s|det(I— sABT) = 0} BTA} = 4, 

then dj(y) 40,1 € J[1,n], for any y € 2(B™ A). Partition Q(s) into [Q,(s), Qo(s)] 
with Q,(s) € R*"*"[s]. It follows from (8.1.2) that 
P(s)[In — sAB* — C]Q,(s) = diag; di(s) 

da(s) 

dils) 


d,,(s) 2 g 
ao = I,,d,(s). 


<=> P(s)[I, — sAB? — C]Q,(s)diag™_, = Ind,(s) 


<= [I — ABT — Cl(Q,(s)diag®., 


Thus, one can choose A(s) = da(s) and 


EA = (u(siaing, ot) P(s). 


to satisfy the relation (8.1.1). Oo 


With this lemma, now we are in a position to provide a closed-form solution of 
the nonhomogeneous Yakubovich-transpose matrix equation (8.0.4). 


Theorem 8.1. Let AER"*?, BER"? and CER’, suppose that 
{s|det(I — sAB’) = 0}(\4(B" A) = ¢, and polynomial matrices L(s) = S775 Lis’ € 


Rls] and H(s) = io Hist € R™"[s], and polynomial A(s) = Xio Ais’ € R[s] 
satisfy (8.1.1) with A(y) 4 0, for any y € A( BTA). Further, let 
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fr,aty(s) = det(Z — sAB*) = ons" + +++ +018 +0, %0 = 1, 


and 
adj(I — sAB*) = Re ap ees + Ryst+ Ro. 


Then all the solutions to the nonhomogeneous Yakubovich-transpose matrix 
equation (8.0.1) can be characterized by 


X= S R;CZ(AŤ B) + S A(BTAY(R;CZ)"B+ > l 
i=0 i=0 i=0 
x R[A(A? B) (AT BY + S` A(BTA)(L:RIA(A BY) B, (8.1.3) 
i=0 
Y = Zp apr)(A’B) + 5 H;R|A(AT B) (AT BY. 


i=0 


Proof. We first show that the matrices X and Y given in (8.1.3) are solutions of the 
matrix equation (8.0.4). A direct calculation gives 


X—AX'B 
n—1 . n—1 . t—1 . 
= X_ RiCZ(A7B)\' + X A(BTA)(RiCZ)"B+ X` LiR[A(A" B) "(AT B} 
i=0 i=0 i=0 
t-1 . n-1 . 
+ XO A(BT A)'(L;R[A(A™B)]")"B— X` A(B7A)'(R:CZ)"B 
i=0 i=0 
n—1 ; t—1 ; 
— 55 ABT(R;CZ)(A7B)'ATB— X` A(BTA)'(L;R[A(A7B)|*)7B 
i=0 i=0 
t-1 i 
— X_ AB” (L;R[A(A7B)]"*)(A7B)'A™B 
i=0 
n—1 ; n—1 ; t-1 
= X R,CZ(A"B)! — \7(AB")R;CZ(ATB)'*" + X` Li 


i=0 i=0 i=0 


t-1 
x R[A(A™B)|"(A7B)' — X` AB” LiR[A(A” B) (A7 B} 
i=0 
n—1 
= RoCZ+ X (Ri — AB" Ri1)CZ(A”B\ — AB” Rn„-ı CZ(A7 B)" + Lp R[A(A™B)] * 
l 
t—1 
+ 


(Li — AB? Li1)R[A(AT B) (ATB) — ABT Li R|[A(AT B) (AT BY. 


an 


i= 


(8.1.4) 
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By the relation (I — sAB*)adj(I — sAB’) = Idet(I — sAB*), it is easily derived 
that 


Ro = aol 
Ri— ABR; = %1, i¢€ Ifl,n-1), (8.1.5) 
—AB? Ry-1 = And. 


So we have 


n—1 
RoCZ+ X_(Ri — AB” Ri-ı)CZ(A"B)' — ABTR,1CZ(A"B)" 
Fi (8.1.6) 


= = 0z% a = CZfa agn) ( A” B). 


In addition, comparing the power of s in (8.1.1) yields 


Lo = CHo + Aol, 
Li— ABT Li = CH;+A;I, ic I[1,t-1], (8.1.7) 
—AB? Lı = CH,+ Ail. 
With these relations, we can easily obtain 
i-1 
LoRJA(A” B)" + X (Li — ABT Lii )R[A(A" B) (A" BY 


— ABT Lı R[A(AT B) + (AT BY\' 
= (CHo + Ao!) R] By CH; + Ail) 
R{A(A‘ B) (ATB) + (CH; + AT) R[A(A‘ B) (ATB) 


t 


= CH;R[A(AT B) (ATB) + YO AiRJA(ATB)]J (ATB) (8-1.8) 
= > CH:RJA(A" B)] (A7 B})' + R[A(A" B)" X A(ATB 


= 5 CH;RJA(AT B) (AT BY + R[A(A7B)|'A(ATB) 


t 
= 5° CH|R[A(A’B)]*(A7B)'+ R. 


Nonhomogeneous Yakubovich-Transpose Matrix Equation 135 


Substituting (8.1.6) and (8.1.8) into (8.1.4), yields 
X —AX'B 


t 
= CZfipapr(A7B) + X` CH; R[A(A’B)| *(A7B)' +R 
i=0 


= of Ziua (A78 + > mwaaa ATD) +R 


i=0 
= CY +R. 


Therefore, the matrices X and Y given in (8.1.3) satisfy the matrix 
equation (8.0.4). 

Next, the completeness of solution (8.1.3) is showed. First of all, from the relation 
(8.1.3) we can see the solution (8.1.3) has rp parameters represented by the elements 
of the free matrix Z. Because {s|det(I — sABT) = 0}NA(BTA) = 4, fuapt)(A7B) 
is nonsingular. So it is showed that the mapping Z — (X, Y) defined by (8.1.3) is 
injective. The proof is thus completed. o 


Regarding the solution of a; i € J[0,n], and R; i€ I[0,n—1], the so-called 
generalized Leverrier algorithm!**! can be stated as the following relation: 
Ri = AB? Rii +o;l, i€lfl,n—1], R= I, 
ic Ifl, n]. 
; 8.1.9 
_ trace(AB? Ri) ( ) 


a 


i 


For relative lower-order cases, the Smith norm form reduction can be realized by 
using elementary polynomial matrix transformation. For high-order cases, the 
Maple function “smith” can be readily employed. 

From theorem 8.1, it is easy to know that under the condition of 
{s|det(I — sABT) = 0}N4A(BTA) = ġ all the solutions of the matrix equa- 
tion (8.0.3) can be explicitly given by 


n-1 g n—1 . 
X = Ð R,CZ(A™B)'+ Y A(BTA)'(R,CZ)" B, 
i=0 i=0 (8.1.10) 


Y = Zfu, apn) (4"B). 


Moreover, from theorem 8.1 it is obvious that a special solution of the matrix 
equation (8.0.4) is 


X= > L,R{A(A™B)|'(A7B)' 
i=0 
+ E A(BTA)(E,RIA(AT BY) "B, 
i=0 
Y= > H,R{A(A7B)|'(A7B)'. 


i=0 


136 Solutions to Linear Matrix Equations and Their Applications 


Similarly to the reference!!! about theorem 8.1 we have the following equiva- 


lent form. First we give the following lemma. The idea of the proof of this lemma is 
motivated by!!4*), 


Lemma 8.2. Suppose that L;, i € I[0,t— 1], and H;, Aj, i € I(0, t], be the coefficients 
of L(s), H(s) and A(s), respectively. Then they satisfy (8.1.1) if and only if 
H; Ai, 1E I{0, tl, satisfy 


t 
S "(AB)" CH; = -Ya (ABT) (8.1.11) 
i=0 
and Li, i € I[0, t— 1], satisfy 
[Lo Ly +++ La] = Ctri( ABT, C)S,(H(s)) + Ctr,(AB?,I,)S;(A(s)In). (8-1.12) 


Proof. From the proof of theorem 8.1 we can see that L;, i€ Z[0,t— 1], and 
H;, Aj, i € I[0, t] satisfy (8.1.1) if and only if they satisfy (8.1.7). So we need to show 
that the relation (8.1.7) is equivalent to the relations (8.1.11) and (8.1.12). 

From the recursive relation (8.1.7), a direct calculation gives 


Lo = CHo + Aol, 
= CH, + ABT CHo + AI + ABAI, 


ae (8.1.13) 
Tyg = CH 4 + AB CH 2+- +(AB "CH 
Ae I Apo ABR™ favs fAg(AB t. 
and 
0= CH,+ ABTCH,, +--+» +(AB)'CHy + Ail + Ay ABT +--+» +Ag(AB*)’. 
(8.1.14) 


The relation (8.1.14) is exactly (8.1.11). Rewriting (8.1.13) in a form gives 
(8.1.12). So it is shown that (8.1.7) implies (8.1.11) and (8.1.12). 
On the other hand, it follows from the relation (8.1.12) that 


ABT Lii 
= ABT CH; + (ABT) CH2 +- +(AB")'CH 
+ A, AB? + ++» +A(4ABTY'. 


Combining this relation with (8.1.11) we can obtain the last expression of (8.1.7). 
For i € I[1,t— 1], from (8.1.12) one has 


ABT Li et OR + Ail 


= ABT ( YABI) CH, + 4(ABTY I) + CH, +A 
j=0 
i-l : Ea 
= E [(4BT)™ CH; + A;(ABT) 7} + CH; +A 
j=0 
= S [(ABT) Gt D-H CH, + A(ABT)S O-H 
j=0 
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This is the second expression of (8.1.7). The first expression of (8.1.7) is obvious. 
Thus the relation (8.1.11) and (8.1.12) imply the relation (8.1.7). So the proof is 
completed. O 

In the following theorem, the solution to the matrix equation (8.0.4) is stated as 
the controllability matrix associated with the matrices AB’ and C, and the 
observability matrix associated with B and the free parameter matrix. This property 


may propose convenience and advantages to the further analysis of the matrix 
equation (8.0.4). 


Theorem 8.2. Let the matrices A € R”"*?, B e R"*? and C € R"*" be given, sup- 
pose that {s|det(I — sABT) = 0}(\A{ BTA} = ¢, and the polynomial matrix H(s) = 
yo, Hi’ c R” and polynomial A(s) = S7i_,Ais' € Ris] satisfy (8.1.10) and 
A(y) £ 0, for any y € 2(B" A). Then all the solution to the matrix equation (8.0.1) 
can be stated as 


X =Ctr(AB’, C)S,(fur,an7)(8)Ir) Obs,(A7 B, Z) 

+ A[Ctr(AB’, C)Sn(f uan (5+) Obs,(A*B, Z)|"B 

+ [Ctr(AB’, C)S,(H(s)) + Ctr( ABT, In)S;(A(s)In)] 

x Obsı( ATB, RJA(AT B) ") (8.1.15) 
+ A{[Ctr( ABT, C)Si(H(8)) + Ctri( ABT, In)5:(A(s)) In] 

Obs;ı( AT B, R[A(A7B)|')}"B, 


Y = Zfa apn (A7B) + SoH; R[A(ATB)] (AB), 


i=l 
where Z is an arbitrary chosen parameter matrix. 
Proof. By the relation (8.1.9), it is easily obtained that 
Ro = In, 


Rı = In + ABT, 
Ro = doln a ABT + (ABTYP, 


Rn-1 = Xn- ln + an2 ABT + hes (AB yr" 


This relation can be compactly expressed as 


Therefore, it is easily obtained 


n-1l i 


Sar, CZ(ABT\ = X> X ay(ABT)* *CZ( ABT)’. 


i=0 i=0 k=0 


138 Solutions to Linear Matrix Equations and Their Applications 


So we have 

n—-1 . 

XC RiCZ(A" B) = Ctr(AB?, C)Sn(f u, aBn (s)L-) Obs,(A*B, Z), (8.1.16) 

i=0 

and 

n—1 . n—1 . 

XC(BTA)(RiCZ)”B = X [R;iCZ(A"B)'|" B 

i=0 7=0 

= [Ctr(AB?, C)$,(f.apr)(8)r) Obs,(A7B, Z)]" B. 

(8.1.17) 


It follows from lemma 8.2 that the relation (8.1.1) holds if and only if the relations 
(8.1.11) and (8.1.12) hold. So we have 


S LiRJA(AT B) (AT B)’ 
i=0 
= [Ly Lı Ly1]Obs,(A7B, R[A(A? B) *) 
= [Ctr( ABT, C)8;(H(s)) + Ctr(ABT, In)S;(A(s)) In] Obs;(A7 B, R[A(A? B)™>*). 
(8.1.18) 


Similarly, one has 


$ (BT A) (ERIAATB))B = » LiRJA(A” BY) (A7B)'| B 
= {[Ctr(ABT, C)S,(H(s)) + Ctr( ABT, In) S:(A(s)) Inl 

x Obs;( ATB, R[A(A7B)|')}7B. 
(8.1.19) 


Substituting (8.1.16)-(8.1.19) into the expression (8.1.3), gives (8.1.15). The 
proof is completed. O 


When the matrix triple (AB’,I,C) is R-controllable, that is rank 
[I — sAB’ — C] = n, for any s € R, the approach of theorem 8.2 can be readily 
employed to solve the matrix equation (8.0.4) without use of Smith normal form 
reduction. This is summarized as the following corollary. 


Corollary 8.1. Let the matrices A € R”"*?, BE R”"*? and C € R"*" be given, sup- 
pose that {s|det(I — s4B’) = 0}(\J{ BTA} = ¢ and (ABT, I, C) is R-controllable. 
Let the polynomial matrix H(s) = + ist € R” satisfy 
t 
XC(AB?)™ CH, = —(ABT)’. (8.1.20) 


i=0 
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Then all the solution to the matrix equation (8.0.4) can be characterized by 
X =Ctr(AB™, C)Sn(f,z,4p7)(8)Ir) Obsp(A’ B, Z) 

+ A[Ctr(AB™, C)Sn(f¢z,4n7)(8)Ir) Obs,(A” B, Z)|"B 

+ [Ctr( ABT, C)S;(H(s)) + Ctr( ABT, I,)] Obs;(A" B, R) 

+ A{[Ctr(ABT, OJS: (H(s)) + Ctri(ABT, I,,)] Obs,(A7B, R)}"B 

Y = Zfapr)(A’ B) + D HRAT B)', 


1=0 


where Z is an arbitrary chosen parameter matrix. 

When (ABT, I, C) is R-controllable, the polynomial A(s) can be chosen to be 1. 
In this case, [A(A?B)]~' = In, S:(A(s)In) = I, and the matrix equation (8.1.11) 
becomes the the matrix equation (8.1.20). Denote [HF HT] + eee this equa- 
tion can be rewritten as 


Ctr:41(AB", C) Hq = —(AB*)’. (8.1.21) 
If the number t is sufficiently large, one has 
rank[Ctr;1(AB*, C)] = rank[Ctr;.1(AB7, C) — (ABT)’). 


In this case, the matrices H;, i€ [1, t], can be obtained from (8.1.21) by using 
some numerically reliable approaches such as QR decomposition approach and SVD 
approach. Furthermore, when the polynomial A(s) is selected to be st, then 
S:(A(s)I,) = 0. Similar to the above arguments, the following corollary can be easily 
obtained. 


Corollary 8.2. Let Ac R"*?, BER"? and CE R” be given, suppose that 
{s|det(I — sABT) = 0}N4{BTA} = ġ and (ABT,I, C) is R-controllable. If the 
polynomial matrix H(s) = Xio Hist € R"*" satisfy 


5-487) icH, =-]. 
i=0 
Then all the solutions to the matrix equation (8.0.4) can be stated as 
X =Ctr( AB", C)S,(fzapt)(8)Ir) Obs,(A” B, Z) 
+ A[Ctr(AB?, C)Sn(f apr (s)I,) Obsn(A7B, Z)” B 
+ Ctr(ABT, C)S;(H(s)) Obs;(A’ B, R(AT BY *) 
+ A[Ctr( ABT, C) S (H (s)) Obs,(A? B, R(AT B) “|B, 


Y= Zfu agn (At B) + D HiR(A # BY, 


where Z is an arbitrary chosen parameter matrix. 
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8.2 The Second Approach 


In this section, we propose an alternative approach to solve the 
Yakubovich-transpose matrix equation (8.0.1). Before proceeding, we need the fol- 
lowing lemma on the matrix equation 


Xo — AX7 B= R, (8.2.1) 


where A € R®?, BE R"*? and RE R”? are known matrices, and Xo is the matrix 
to be determined. 


Lemma 8.3. Let the matrices A E€ RP, BE R”*P and R € R”? be given, suppose 
that {s|det(I — sABT) = 0} BTA} = 4, and let 


fr.apt)(s) = det(I — sAB*) = ans” + ++» +018+09, %0 = 1, 


and 
adj(I — sAB") = X` Ris. (8.2.2) 
Then the unique solution to the matrix equation (8.2.1) can be characterized by 


o= [So RRA AT By y+ So RART LAT By'] x Fu agn (ATB. (8.2.3) 


i=0 


Proof. According to the theorem 8.2 in the reference” , we have 


als a,(AB)** R(A™ B)! 


i=0 k=0 


q 
L 


$ DoF (ABT) ‘AR B(ATB)') [Foann (ATB)] 


i=0 k=0 


By the relation (8.1.9), we have 


So we can obtain the following conclusion 
n—1 n—1 
Xo = |X_ RiR(ATB)'+ $0 RAR" B(ATB)' 


x [Faz (A7B) 
i=0 i=0 


Thus, the proof has been completed. o 
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Suppose that a solution to the nonhomogeneous Yakubovich-transpose matrix 
equation (8.0.1) can be expressed as X = T+ X,Y = Y with (X,Y) being a 
solution to matrix equation (8.0.2). Then one has 


(TeX) oA P+ x) B= CY =F 
= X—AX'’B+T—AT'B-CY—R=T—AT'B_R. 


It follows from this relation that X = T+ X, Y = Y is a solution to (8.0.2) if 
Xo = T is a solution to (8.2.1). Combining this fact with the solution (8.1.10) to the 
matrix equation (8.0.2), now we have the following conclusion on the solution to the 
Yakubovich-transpose matrix equation (8.0.1). Different from theorems 8.1 and 8.2, 
one does not need to solve the polynomial matrices H(s) and L(s), and polynomial 
A(s) when applying theorem 8.3 to obtain general solutions to the 
Yakubovich-transpose matrix equation (8.2.1). 


Theorem 8.3. Given matrices A € R”*P?, Be R”? and C € R"*", suppose that 
{s|det(I — sAB*) = 0}(A{ BTA} = 4, and (8.2.2) holds. Then all solutions to the 
nonhomogeneous Yakubovich-transpose matrix equation (8.0.4) can be expressed as 
n=l 
X= S Roza" B)'+ XC A(BTA)'(RiCZ)"B 

i=0 i=0 
n=1 . n-1 . 
X  RiR(A"B) + $` RiAR"B(A"B}' 
i=0 i=0 
Y =Zf aBn) (A”B), 


=1 
+ x [Fan (47B) ’ 


where Z € R°% is an arbitrary chosen free parameter matrix. 
In addition, it is easily known from theorem 8.3 that 


n-1 $ n—1 à -1 
= b R;R(ATB\ + `, RAR BAT) x [faen (ATB)| , 
i=0 i=0 
Y =0, 
is also a special solution to the matrix equation (8.0.4). 
Similar to derivation in section 9.1, we can also obtain some equivalent forms of 
the solution in theorem 8.3. 


Corollary 8.3. Let the matrices A € R”*?, BE R”*P and C € R"*" be given, sup- 
pose that {s|det(I — sABT) = 0} BTA} = @, and (8.2.2) holds. Then all solu- 
tions to the nonhomogeneous Yakubovich matrix equation (8.0.4) can be 
characterized by 


X= S Ri[CZ + R[f razr) (ATB) (AT BY + S {(4BTYA(R;0Z)" 
i=0 i=0 
+ RiA[(ABT)' R] [fu apn (4 B)] > }B, 


Y= Zf(1,4B") (A*B), 


where Z € R”? is an arbitrary chosen free parameter matrix. 
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Corollary 8.4. Let the matrices A € R"*?, BER"? and C € R” be given, 


suppose that {s|det(I — sABT) = 0}(A{ BTA} = @, and (8.2.2) holds. Then all 
solutions to the nonhomogeneous Yakubovich matrix equation (8.0.4) can be 


characterized by 


X =A([Ctr(AB,[C R)I? Safa, agn (Sra) 
ZB" 


T 
Rifa as (AT B))B )) 
+ Ctr(AB™,[CR])Sn(fiz,apry(8)Ir+p) 


armil) 


Rļf q 4g (AB) 
where Z € ’*? is an arbitrary chosen free parameter matrix. 


Obs, (ot 


Obs, [u's 


Y =Zfapn(A’ B), 


8.3 Illustrative Example 


In this section, we give an example to obtain the solution of the nonhomogeneous 
Yakubovich-transpose matrix equation in the form of (8.0.4). 


Example 8.1. Consider the nonhomogeneous Yakubovich-transpose matrix equa- 
tion in the form of (8.0.1) with the following parameters: 


=o =i $ 30 22 —4 
A=|1ı1 1 0 |, R=| -1 -1 6), 
-1 0 1 -11 -3 -1 
0 1 30.5530 13.7765 6.9924 
B={2 1 0 |,C=]| —7.3409 —0.3371 1.8106 
—1 —1.1667 0.4167 0.8333 


It is easy to check that {s|det(I — sABT) = 0}(\4(B" A) = ġ. By simple com- 
putations, we have 


det(I — sAB*) = 8 — 3 +3s+ 1, 


-18 6 -30 
fa asn (47B) = | -72 24 -108 |, 
-78 24 —114 
: 0.3333 0.0833 —0.1667 
Fer agn (ATB)| = | —0.5000 0.6667 —0.5000 


—0.3333 0.0833 0 
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In addition, we have 


1 0 0 —2 -8 -1 =1 -6 =b 
R=10 1 0), R=] 1 6 1j, Ms] 1 5 4 
0 0 1 0 -2 2 —2 -10 -7 
1 2 -1 
Choose Z = | —2 0 —4 |. So by theorem 8.3 we have 
0 3 1 
3.0000 12.0000 —3.0000 
X = | 1.0000 9.0000 13.0000 |, 
5.0000 5.0000 1.0000 
—84.0000 30.0000  —132.0000 
Y = | 348.0000 —108.0000 516.0000 
—294.0000 96.0000 —438.0000 


8.4 Conclusions 


In this chapter, we have proposed parametric solutions to the nonhomogeneous 
Yakubovich-transpose matrix equation. These solutions can provide all the degrees 
of freedom, which are represented by an arbitrarily chosen parameter matrix Z. All 
the coefficient matrices are not restricted to be in any canonical form. The matrix B 
explicitly appears in the solutions, and thus can be unknown a priori. Therefore, the 
matrix B can also be viewed as some free design parameters in some problems 
related to the matrix equation (8.0.4). Meanwhile, an equivalent form of the solu- 
tions to the nonhomogeneous Yakubovich-transpose matrix equation has been 
expressed in terms of the controllability matrix associated with A, B, and C, and 
observability matrix associated with A, B and the free parameter matrix Z. Such a 
feature may bring greater convenience and advantages to some problems related to 
the nonhomogeneous Yakubovich-transpose matrix equation. Moreover, by speci- 
fying the obtained solutions, some expressions can also be given for the solutions to 
the normal transpose matrix equations. From the discussion in this chapter, one can 
observe that the solutions to the nonhomogeneous Yakubovich-transpose 
matrix equation are crucial as the theoretical basis of the development of many 
kinds of other matrix equations, and are deserved further investigation in the 
future. In addition, as the theoretical generalization of the well-known 
Karm-Yakubovich-transpose matrix equation, it may be helpful for future control 
applications. 


Chapter 9 


Explicit Solutions to the Matrix 
Equations XB — AX = CY 


and XB — AX = CY 


In this chapter, we are concerned with the explicit solution to the generalized 
Sylvester matrix equation in the real field and the generalized quaternion 
conjugate matrix equation over the quaternion field. In order to obtain the 
explicit solution of the generalized Sylvester conjugate matrix equation, we 
present a polynomial matrix algorithm. It is also shown that the explicit 
solution to the considered matrix equation is expressed as the coefficient matrices 
A, B,C, the free parameter matrix Z and the coefficient matrix of the polyno- 
mial matrix adj(sIz,— 4A). Moreover, we study the generalized Sylvester 


quaternion jconjugate matrix equation XB — AX = CY based on the idea of the 
references|°:149:160.184,187,188] anq provide the closed-form solutions to this quaternion 
conjugate matrix equation by applying the real representation of a quaternion 
matrix. Compared to the complex representation method!"*4, the real representa- 
tion method does not require the coefficient matrix A to be any special case. As the 
special case of the generalized Sylvester quaternion #conjugate matrix equation, the 
Sylvester quaternion conjugate matrix equation XB — AX =C is also investi- 
gated. The explicit solutions to this kind of matrix equation have been established. 


9.1 Real Matrix Equation XB — AX = CY 


We consider the following generalized Sylvester matrix equation in real field 


XB- AX = CY. (9.1.1) 


Theorem 9.1. Let A € ®"*", BER”? and C e R”% be given real matrices. 
Suppose 1(A)N A(B) = @, the following relations 
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fals) = det(sf — A) = ans" + ++ 4048+ ao, an = 1, 


and 
adj(sf — A) = Reis! + --- +Ris+ Ro, 


hold true. Then all the solutions to the generalized Sylvester matrix equation (9.1.1) 
can be established as 


(9.1.2) 


where the matrix Z € R”? is an arbitrary matrix over real field. 


Proof. First of all, we prove matrices X and Y given in (9.1.2) are the solutions to 
the matrix equation (9.1.1). By the direct calculation we can obtain 


n-1 n-1 
XB-AX= 5 R;CZB +! — A` R.CZB' 
=e =e (9.1.3) 


n—1 
= R,_,CZB" + N (Ra — AR) CZB' — AR, CZ. 
i=l 
According to the relation (sI — A)adj(sf — A) = Idet(sI — A), it is easy to derive 
the following relations 


—ARo = aol, 
Ri-y — AR; = a;l, i= 1,2,..., n — 1, (9.1.4) 
Rn-1 = Opt. 


So one has 


n—-1 n 
Rn-1CZB" + S~(Rj-1 — ARi) CZB' — AR) CZ = CZ «B = CZf ,(B) = CY. 


i=1 i=0 


Therefore, matrices X and Y given in (9.1.2) satisfy the matrix equation (9.1.1). 

Next, we prove the completeness of the solution (9.1.2). It follows from theorem 6 
of" that there are rp degrees of freedom in the solution of the matrix equation 
(9.1.1), while solution (9.1.2) has exactly rp parameters represented by the elements 
of the free matrix Z. So we only need to show that all the parameters in the matrix Z 
contribute to the solution. For all this, it suffices to show that the mapping Z — 
(X, Y) defined by (9.1.3) is injective. This is true since f ,(B) is nonsingular under the 
condition of A(A) N A( B) = ¢. Thus, the proof has been completed. Oo 


Remark 1. This result is the same as corollary 2 in!5°l_ Inl50, the authors presented 
the solution to the generalized Sylvester matrix equation (9.1.1) in terms of the 
Krylov matrix, a symmetric operator matrix, and the generalized observability 
matrix by applying matrix polynomial and linear solution space. Corollary 2 in! is 
an equivalent form of the presented solution. However, here we establish the solution 
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by applying the characteristic polynomial sI — A of coefficient matrix A and the 
coefficient matrix of the characteristic polynomial sI — A. 

In reference!®!, we can find the following well-known generalized 
Faddeev-Leverrier algorithm: 


a k = Ry k+1 A+ On k+iln; Rn =0,k = 1,2,...,.n—1, 


t Rn- A az 
trace HnckA) ST ee (a 
k 

where q&;, i = 0,1,2,..., n — 1, are the coefficients of the characteristic polynomial of 
the matrix A, and R;,i=0,1,...,n—1, are the coefficient matrices of the adjoint 
matrix adj(sI, — A). 


n-k = 


Theorem 9.2. Let A € R”””, BE RP”? and C € R”? be given matrices, suppose 
fals) = det(sl — A) = ans” + +++» +aj8+ 09,0, = 1. 


Then matrices X and Y given by (9.1.2) have the following equivalent form 


n—1 n . P 
x= yA OZB, 
i=0 k=i+1 


Y = Zf 4(B). 


(9.1.6) 


Proof. Due to the relation (9.1.5), it is easy to obtain 


Ro = uI +A- Bae ae +A, 


Rn-2 = n- 1 + A, 
Rais. 


This relation can be compactly expressed as 


n 
R, = >. aA] an= 1,i=1,2,...,n—1. 
k=i+1 


Substituting the above relation into the expression of X in (9.1.6) and recording 
the sum, we have 


n-1 n—1 n n—1 n 
X=Y RCZ =Y ( 5y aA) OZB =Ñ Ņ A OZB. 
i=0 i=0 `k=i+1 i=0 k=i+1 
Combining this with theorem 9.1 we can prove the conclusion. O 
Remark 2. The above conclusion is essentially the same as theorem 9.2 in! 1491, In”, 


the authors provided the solution to the generalized Sylvester matrix equation 
(9.1.1) with the column vector form of the unknown matrices X and Y by means of 
the matrix polynomial and Faddeev-Leverrier algorithm. In the current paper, we 
present the equivalent form of theorem 9.1 using the well-known generalized 
Faddeev-Leverrier algorithm. 
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9.2 Quaternion-7Conjugate Matrix Equation 
XB- AX = CY 


9.2.1 Real Representation of a Quaternion Matriz 


For any quaternion matrix A= Á + Azi + A3jt+ Aak E Q"™", APE R”™” 
(1 = 1, 2,3, 4), the real representation matrix of quaternion matrix A can be defined as 


A & -A A 
— Ay — AÁ; — A4 — Á} 4mx4n 
t= A 4, a, |e. (9.2.1) 


Ay A3 Ag —A, 


For an m x n quaternion matrix A, we define A‘ = (A,)‘. In addition, if we let 


L 0 0 0 0 =] 0 0 
{0 -L0 0 oJ 0 0 0 
P=] o ọ L 0 Qı 0 0 0 LP 
0 0 0 =F; 0 0 =- 0 
0 0 0 =<] 0 0 & 0 
pt. 0 Ļ 0 |0 0 0 7, 
s= 0 -I, 0 0 a= -I 0 0 O}7 
L 0 0 0 0 -L 0 0 


in which J; is a t x t identity matrix, then P;, Qi, Sn, Ri are unitary matrices. 

For the expression (9.2.1), we can see that ø : A — A, is a mapping from the 
quaternion matrix A to its real representation matrix A, for any quaternion matrix 
A. In this case, for a real matrix A € , the invertible mapping o~! can be 
stated as: o |: Aj. = B, in which B € Q”%” is a quaternion matrix. We observe 
that the mapping ø is an injective homomorphism. The real representation matrix 
has the following properties, which are given inlt88], 


gins An 


Proposition 9.1. Let A, B € Q”*",C € Q””*’, a € R. Then 

) (A+B), = As + Bo, (aA), = aAg, (AC), =A,P,C,= ALO Ps; 

) A= B 4> A, = Bs; 

3) 0, Ac Qh = — Ás, RA, Rn = Ag, G2 A), = —Ag, PO AGP a = (A),; 
) 


N 


The quaternion matrix A is nonsingular if and only if A, is nonsingular, and the 
quaternion matrix A is an unitary matrix if and only if A, is an orthogonal 
matrix; 

5) If A e Q™", then A¥ = ((AA)*"), Pm; 

6) A € Q”*™, Be Qn", C e Q”” and k+ lis even, then 
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A‘C,B! = ((AA)*(ACB)(BB)'),, K=2s+1,0=2t+1, 
eee A)°C(BB)' k = 28,1 = 2t. 


Proposition 9.2. If 4 is a characteristic value of A,, then so are +A and +2. 
For any A € Q™%*™, let the characteristic polnouae the real representation 


matrix A, be fa (A) =det(Alam— Ac) = Wim) a24", and define ha,(4) = 


oe = ae ") So by propositions 9.1 and 9.2 we have the following 
ieee hea 9.3. 


Proposition 9.3. Let A € Q”*™, Be Q"*". Then 


(1) fa, (2) is a real polynomial, and f4, (2) = yp a24"; 
(2) ha,(4) is a real polynomial, and h4,(4) = o agh? C"), 
(3) ha,(Bo) = (94 (BB); Pn, fa,(Bo) = (pa,(BB)),Pn, in which — 94,(2) = 


ao, 4, pa, (A) = 27) az4" are real polynomials. 


Proof. By proposition 9.2, we easily know that a, is a real number, and aoz41 = 0. 
For any k, by proposition 9.1, we have B?" = ((BB)") Pn. Thus, we can obtain the 
result (3). o 


Furthermore, we have the following conclusion on the relation of quaternion 
matrix and quaternion conjugate matrix. 


Proposition 9.4. Let A € Q”*™, B € Q™*™. Then 


(1) A=Bes A=B; 
(2) A=B<> A=B; 
(3) A= 4; 

(4) AB= AB 


Proof. By the definition of quaternion jconjugate matrix A, items (1), (2) and 
(3) can be proved. Now we prove item (4). Let A= A; + Agi+ A3j+ Agk, 
B = Bı + Boi+ B3j + Bik. By calculation we have 
AB =(A,B, Ay Bo A; B3 A,B,) ł (A, Bo t Ay Bı t A; By A,B3)t 
+ (Ai B3 + A3Bı — Ao By + Ag Bo)j+ (AsBi + Ai B4 + A2B3 — A3B2)k, 


AB S(Aj Bı — AgBy = Ag By = A4B14) = (Aı B2 + Asi + Agi — A4B3)i 
+ (41B; + A3 Bı — AaB, + A4 Bo)j — (A4Bı + A1 B4 + A2 B3 — Ag Ba)k, 


and 


AB =(A,B, A» By A; B3 ABa) +( Aı Bə AB: A;B, + A,B3)i 
t (A, Bs t A; Bı Ay B44 A4Bo)j t ( A,B, — A, B4 A» B3 t A3Bo)k. 
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Hence we have AB = AB. oO 

In the real field, for two square matrices, if there exists a real number / satisfies 
det(A+ AB) Æ 0, then the real matrix pair (A, B) is called real regular matrix pair. 
Similarly, we have the following definition on the quaternion regular matrix pair. 


Definition 9.1. Let A, B € Q”*”. If there exists 4 € R such that 
det(A, +2B,) 4 0, 


then the quaternion matrix pencil (A, B) is called a quaternion regular matrix pair. 
According to definition 9.1, it is easy to obtain the following lemma. 


Lemma 9.1. Quaternion matrix pair (A, B) is a quaternion regular matrix pair if 
and only if its real representation matrix pair (A,, B,) is a real regular matrix pair. 


9.2.2 Solutions to the Quaternion j- Conjugate Matriz 
Equation XB-— AX = CY 
In this subsection, we will discuss the solution of the following quaternion #conjugate 
matrix equation 
XB- AX = CY, (9.2.2) 
in which A € Q"*", Be QP? and C € Q"*" are known quaternion matrices, X € 
Q”? and Y € Q’*? are unknown quaternion matrices. 


Firstly, we define the real representation of the generalized Sylvester quaternion 
#conjugate matrix equation (9.2.2) by 


V(B), — Ac V = CW. (9.2.3) 


Due to propositions 9.1 and 9.4, the generalized Sylvester quaternion matrix 
equation (9.2.2) is equivalent to the following matrix equation 


(XB = AX). = XP B, — Age Py. 
Post-multiplying the two sides of the above quaternion matrix equation by P,, 


the matrix equation (9.2.2) can be converted into 
KAD — AoXo = Col Y), 


In this case, we have the following conclusion. 


Proposition 9.5. Let A € Q"*", Be Q”? and CEQ” be given quaternion 
matrices. Then the quaternion matrix equation (9.2.3) has a solution (X, Y) if and 
only if the real representation matrix equation (9.2.3) has a solution 


(V, W) = (Xo, (¥),): 


Theorem 9.3. Suppose A € Q"*”", Be Q?’*?, C € Q”" be given quaternion matri- 
ces. Then the quaternion matrix equation (9.2.3) has a solution (X, Y) if and only if 
the real representation matrix equation (9.2.3) has a solution (V, W). Furthermore, 
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if (V, W) is a solution to (9.2.3), then the following quaternion matrices are solutions 
to (9.2.3): 


1 
X= cc Un in jin kIn] x (V — QG VQ, + R3 VR, — Sp VSp) 


1 
You M, il, jl, kI,] x (W -— Q,'WQ,+ 8, WR, — 5, WS,)t 


Proof. By (3) of proposition 9.1, the quaternion matrix equation (9.2.2) is equiva- 
lent to 


A 


VR, (B), Rp — Ry Ao Rn V = Rọ CoR, W. (9.2.5) 
Post-multiplying both sides of the matrix equation (9.2.5) by A we can obtain 


-1/ Ñ —1 -l_p-l —1 
VR! (È), — Ry) Ac R, VR,! = R;' CoR, WR;!. (9.2.6) 


Pre-multiplying both sides of the matrix equation (9.2.6) by Rn, we have 
-1 î = = 
R VR, (B), — AcRn VR, = CoR, WR, - (9.2.7) 
Noting A = —R,, we give 
R! VRp(B), — AcR;' VRp = Co R; WRy. 


This shows that if (V, W) is a real solution of matrix equation (9.2.3), then 
(R,,' VRp, R,' WR,) is also a real solution of quaternion matrix equation (9.2.3). In 
addition, according to (3) of proposition 9.1, the quaternion matrix equation (9.2.3) 
is also equivalent to 


VQ (B) Qp — Q'A Qn V = QG’ CoQ, W. (9.2.8) 


Post-multiplying both sides of the quaternion matrix equation (9.2.8) by Q we 
have 


Vas (Bje= Q AQ VO = Q,' CoQ, WO (9.2.9) 


Pre-multiplying the two sides of the quaternion matrix equation (9.2.9) by Q7! 
and computing A = — Qp, give 


(-@,'VQ,)(B), — As(-@, VQ,) = Col- Q71 WQ,). 
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This is to say that if (V, W) is a real solution of matrix equation (9.2.3), then 
(-Q;" VQ, — am WQ,) is also a real solution of matrix equation (9.2.3). Similarly, 
we can prove (—S,'VS,,—S;'WS,) is also a real solution of quaternion matrix 


equation (9.2.3). In this case, the conclusion can be obtained along similar line of the 
proof of theorem 4.2 ins, o 


Theorem 9.4. Given quaternion matrices A € Q”%*”, Be QPP and Ce Q", 
suppose 


2n 
fa (8) _ det (sl4n m Ac) = 5 as], 
k=0 
and 


2n 
= J anys". 
k=0 


Then the quaternion matrices X € Q"*?, Y € Q”? can be established as 
2n 


X= A 3) (4a) 1 4@Z(BB)® 


k=1 s=k— 


> onl “CZB(BB)), (9.2.10) 


in which Z is an arbitrary quaternion matrix. 


Proof. If the generalized Sylvester quaternion #conjugate matrix equation (9.2.2) 
has solution (X, Y), then the real representation matrix equation (9.2.3) has solution 


(V, W) =(X.,(Y),) with the free parameter Z,. By theorems 9.2 and 9.3, we have 


4n-1 An ene 
Ga YOO Ae 
j=0 k=j+1 
~~ 2kAg ( ) 
j=0 k=j+ 
2n r 2n—1 g ee 
= Yow) ABI" CZB) 
k= © j=k— 
2n r n- 
— aal Y Az 2s— 10,Z,(Ê Dopa A 2C 7(B ya '] 
k= - s=k— 
2n r n— n p 
= Yoox] i AACA E A a] 
k= © s=k— s=k 
= mk = Gy k-s-1 a7 s z A \k-S YO D Dy\s-1 
=Sran| © ((AA)**1402(BB)) + Y ((AA)* "OF BBB) 
k= t- s=k— G s=k Q; 
2n n— Pa R Jot n-1 Aa = gel ae ee 
= age 3S ((Aa)**402(BB)’) me ((44)**"'cZB(BB)’) I 
k= + she a s=k-1 ¢: 
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So we have 


2n n—-1 n—1 
X=Y] (AA) = ACABA Y (AA CZAR). 
k=1 s=k-1 s=k-1 


In addition, according to proposition 9.3, f 4, (s) is a real polynomial and we have 
the following relation 


A 


fa, (Bo) = [pa,((BB))|Pp- 
Thus, according to proposition 9.1, we have 
(P), = Zofa,(Bo) = Zolpa,((BB),)|Pp = [Zp1, (8B) 
Therefore, from proposition 9.4 we can obtain the following relations 
Y = Zp,, (BB), 
and 
Y = Zp, (BB). 


Thus, we complete the proof of the conclusion. O 


In the following, based on the main result proposed above, we consider the 
following Sylvester quaternion #conjugate matrix equation 


XB- AR =C. (9.2.11) 


Corollary 9.1. Given quaternion matrices A € Q"*", B € QP”? and C e Q™?, let 


2n 


fa (8) = det(sIan — Ac) = XC ag, 


k=0 


and 


(1) If X is a solution of the equation (9.2.11), then 


pe 2n k-1 be oe we k-1 ee as Boe 
Xp, (ÊB) = © a] (AA) CB(BB) "+ y(Ad)"AC( BBY]. 
k= 


s=0 s=0 
(9.2.12) 
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(2) If (A,B) is a regular quaternion matrix pair, then the quaternion matrix 
(9.2.11) has a unique solution 


X= SS m| (AA) CBBB) + F(A) AC BB Ipa (BB 


(9.2.13) 


Proof. If X is a solution of the equation (9.2.10), then Y = X, is a solution of the 
real matrix equation X,B; — A,X, = C;Py. By theorem 3 in” and proposition 
9.1, we have 

4n k-1 


Xefa (B) =X X Ai C P b 


k=1 j=0 


From proposition 9.3, f4 (s) is a real polynomial and fa (Bo) = (p4,(BB)), Py: 
So using proposition 9.1, we have 


[Xp4,(BB)]; 
= X,[p4,(BB)],P» 
= =Xof 4, (Bo ) 
4n k-1 
= 2, dm AsOe Pf By —j—-1 
0 
2n - 
= NO a Al CoP (B) 
k=1 j=0 
2n _ k= k 
= Aok Ss CP a By Qs-1 ey AP CPB a 2 
k= ~ 5=0 s=1 
n _ k- 
=S a YAGP Boe 14 SAC, PB | 
F o N N g 
-a| E (aayreB(08)") +$ (udaan) 
k= ~ s=0 a gi o 
w ore P se ba o 
=X [X (Ad) CB(BB)) + Y (âa agb) J. 
k= ~ s=0 a =0 o 
So we have 
2n k-1 1 
Xp,,(BB) =X o| X (AA BB + SAA AABB] 
k=l s=0 s=0 


Thus, the conclusion has been proved. O 
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In the following, we give an example to obtain the solution of Sylvester 
quaternion matrix equation XB — AX =C. 


Example 9.1. Consider the explicit solution of the Sylvester quaterniom matrix 


equation XB — AX = C with the following parameters: 


fl OF)... 7349 2-k 
AE 4) 


eis 12+ 4i— 6k 4 — 4i— 10k 
~\ 9-444 7j7- 13k 1—7i+9j7 44k)" 


According to the definition of real representation of a complex matrix, we have 


10 02 00 0 0 
o0 0 0 0—10 0 -1 
0o 2 -10000 0 

aloo 0 0 0 1-1 0 

elo o 0 0 100 2 
10 01 00 0 0 
o 0 0 0 0 2 <1 0 
0-1 100 00 0 


It is easy to check the quaternion matrix pair (A, B) is regular. By some simple 
computation, we have 


fa (9 = 8 - 4 + 6st — 457 +1, 


pa,(s) = $ — 48 +68 — 4s+ 1, 


and 


ags = 1, x = —4, 04 = 6,02 = —4, %0 = 1. 


It follows from corollary 9.1 that the solution of the Sylvester quaternion matrix 


equation is 
2 1-21 
a= E k 4j ). 


9.3 Conclusions 


In this chapter, the real generalized Sylvester matrix equation XB — AX = CY and 
the quaternion matrix equation XB — AX = CY have been investigated. We have 
provided a new solution to the real matrix equation XB — AX = CY through a 
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direct method. Based on the solution of this real matrix equation and the real 
representation of a quaternion matrix, we have established the explicit solutions of 
the quaternion matrix equation XB — AX = CY. Compared to the existing 
results!'*4), there is no requirement for the coefficient matrix A. But in the refer- 
ence’, the coefficient matrix A is restricted with a block diagonal complex matrix. 
In this sense, the results in this chapter can be regarded as the further result of the 
reference!*4!, It is the generalization of existing results. As a special case of the 
generalized Sylvester quaternion jconjugate matrix equation, Sylvester quaternion 
Feonjugate matrix equation XB — AX = C has also been considered in this paper. 
The explicit solutions to Sylvester quaternion jconjugate matrix equation have been 
proposed. 


Chapter 10 


Explicit Solutions to Linear Transpose 
Matrix Equation 


In this chapter, we consider the explicit solutions to the equations 
AX+X'™B=C, (10.0.1) 
and 
AX+X™B=CY, (10.0.2) 


where A, B, C € R”*” are given n x n real matrices and X, Y € R”*” are unknown 
nx n real matrices to be determined. They are named the Sylvester transpose 
matrix equation and the generalized Sylvester transpose matrix equation, respec- 
tively. If X = XT, the equations (10.0.1) and (10.0.2) reduce to the well-known 
Sylvester (or generalized Sylvester) matrix equation, which has many important 
applications in control theory. For calculating the solutions to (10.0.1) and (10.0.2), 
three algorithms are provided in this chapter. The design of a time-varying linear 
system in control is given. 


10.1 Solutions to the Sylvester Transpose Matrix 
Equation 


In this section, the explicit solutions to (10.0.1) are considered and three forms of 
solutions are constructed. One of the solutions is the well-known Jameson’s 
Theorem. In this sense, we generalize Jameson’s Theorem from the Sylvester matrix 
equation to the Sylvester transpose matrix equation. Firstly, some useful lemmas are 
summarized below. 


Definition 10.1 (Sylvester sum"). Let T(s) = Slo Tist eC, F € C”, and 
Z €C®?, the following matrix sum Syl(T(s), F, Z) = $>i_ọ TiZF' is called Sylvester 
sum. 
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Definition 10.2 (Kronecker map"). Consider the polynomial matrix T(s) = 
Sio Tis’ €C"™ [5], for a fixed F €C”, the map ®[T(s)] = 71_,(F7)'® T; is 
called ®-Kronecker map. 


Lemma 10.1. Let X(s) € C®"[s], Y(s) €C’™™[s], then ®[X(s) Y(s)] = ®[X(s)] 
[Y (s)]. 


Lemma 10.2. Let T(s) € C’*[s], then ®[adj(T(s))]®[T(s)| = D[,det T(s)]. 


10.1.1 The First Case: A or B is Nonsingular 
Define 

fa,ptay(s) = det(In — sBTAT') = an” +- Hast ao, %=1, (10.1.1) 
and 


adj(I„ — sB? A`) := Ynis! + -+ Yis + Yo. (10.1.2) 


Theorem 10.1. Let A be nonsingular and 41, 22, . - ., An be the eigenvalues of BTA}, 
thus, we have 


(1) Supposed that X is a solution to equation (10.0.1), then 


Xf a, pran ((B7A)*) = A` Srce (BA) Ba TY. (10.1.3) 
i=0 


(2) If 2:4; A 1 for all i, j, then equation (10.0.1) has a unique solution 
n=1 
X=A "|Y 1C- (BTA CO WOE AYY | x fa sayl A) (10.1.4) 
i=0 
Proof. From lemma 10.1, equation (10.0.1) can be equivalent to 
Syl(I„ — sBTA™!, (BTA), AX) = C — (BTA! 0)". 
By definitions (10.1.1) and (10.1.2), the above relation can be rewritten as 
®[I, — sBT A`']vec(AX) = vec(C — (BTA! C) "). 
From lemma 10.2, we have 


®[I,det(I, — sB? A~!)]|vec(AX) = ®[adj(I,, — sB? A~+)|vec(C — (BTA! 0) ”). 
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So we get 


Syl(Indet(I, — sB7 A`), (B?A71)", AX) 
= Syl(adj(I„ — sBT A), (BT A)" ,C — (BTA! 0) "). 


By simple computation, one can obtain 


Syl(Indet(I, — sB?A~'),(B7A™)", AX) = AXf u, gra ((B7A7')*), 


and 
Syl(adj(In — sBTA™!), (BTA!) ", C — (BTA! C) ") 
n—1 
=) ¥\(C - (BPA *C)*)((BTA)7Y*. 
i=0 
Thus, we get 
n-1 
Xf pray ((B7A)") = AYO YC — (BTA ™C)*)(BTA)*)". 

i0 


If A;A; #1 for all i,j, then fagran (BTA) is nonsingular. Therefore, 
equation (10.0.1) has a unique solution and (10.1.4) holds. o 


Now, we summarize the well-known generalized Leverrier algorithm!“ as 
follows: 


Yy = Yy- BTA! + apIn, Yo =In,k=1,2,...,.n, 
t Y,- BTA! 10.1.5 
ak = race( m ) bo = 1, k = 1,2,...,n, ( ) 


where &;, i = 0,1,2,...,n — 1, are the coefficients of the characteristic polynomial of 
BTA, and Y;,i=0,1,...,n—1, are the coefficient matrices of adj(sI, — BTA”). 
Applying (10.1.5), we will provide the following results. 

Theorem 10.2. Let A be nonsingular and 21, A2,..., An be the eigenvalues of BT A7!. 


(1) Supposed that X is a solution of the equation (10.0.1), then 


2 j E act T Pah j (10.1.6) 

-AYY (BTA (O = (BT AO) (BPAY), 

j=0 k=0 
(2) If A;A; Æ 1 for all i,j, then the unique solution to (10.0.1) is stated as 

n-1 j . i 

Yi A X aBa (C = (BT AC) "(Bi ay) 
rae (10.1.7) 

ei pte A”) 
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Proof. From (10.1.5), we get 


Yı = Ailn ai BTA, 
Yə = oT n are a, BT A! + (aay. 


Yni = äni In ton BTA + -+ (BrAYy™, 


The above formula can be rewritten as 


Therefore, we have 


n—1 


 ¥(C = (BTA C) (BTA) 
D aata) (C - (BTA O) PI((BTA) T) 


=F a(BTA (C - (BTA OY (BTA), 


j=0 k=0 


Combining this relation with theorem 10.1, (10.1.6) can be proved. If 1,4; # 1 for 
all 7,7, then fur.ptay((B7A™)") is nonsingular. Thus, (10.0.1) has a unique 
solution. So the desired result follows. Oo 


Remark 1. This theorem is the Jameson’s Theorem of the Sylvester transpose 


matrix equation (10.0.1), which has the same form as theorem 7 in", 


Theorem 10.3. Supposed that A is nonsingular, let 21, 42,...,4, be the eigenvalues 
of BTA* and C—(BTA'C)? = Ci C, C1 E€ R”*",C3 € R% hold, where 
r =rank(C — (BT A™! C) "). 

(1) Let X be a solution to (10.0.1), then this solution can be stated as 


XÍ, BTA) ((B7A7")*) 


= AQ (BT A C T 4—1 T j-1\T (10.1.8) 
= c , 1,n)5,(I, B A )Q,((B A ) , C2, n). 


2) If 2;4; Æ 1 for all i,j, then the unique solution to (10.0.1) can be expressed as 
j 
X =A Q,(BTA™, C1, n)5,(, BPA) Q,((B7A1)", Co, n) 


: ssa (10.1.9) 
x for, pra) ((B A`) ie 
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Proof. According to (10.1.5), we have 


[YoC: NC +++ YniCi)] = Q,(B7A™", Ci,n)S,(1, BTA"). 
Thus, it is easy to obtain 


n-1 . 
YC — (B7A™*C)*)((BPA71)*)' 

i=0 
= [Yo C1 YiCy © Yra C1)9,.((BT A)’, C2, n) 
= Q(B A, Ci, n)5,(I, BTA) Q,((B7 A)”, Co, n). 


Combining this relation with theorem 10.2, (10.1.8) can be proved. If 4;A; 4 1 for 
all i, 7, then fa, pra-y((B7A™)") is nonsingular. Therefore, (10.0.1) has a unique 
solution and (10.1.9) holds. Oo 


Remark 2. From corollary 1 inb, the sufficient condition for existence of solution to 


(10.0.1) is that A” + C and A? — C are nonsingular under the condition C? = C. 
From corollary 2 inb, the necessary and sufficient conditions for existence of 
solution to (10.0.1) is that AT + C is nonsingular under the conditions C’ = C and 
(I — PI)Bš(I — Pa)=0, where Pa =(AT-— B) "(AT+B) and B= 
OA + B) (AT — B) + (AT — B) A + B) 17 C. 
Compared with corollaries 1 and 2 inb, the sufficient condition for existence of 


solution to (10.0.1) in theorem 10.3 only requests 2u + 1 for any A, u € o( BT A“). 
This condition is easy to check through Matlab. 
Suppose that B is nonsingular. Taking the transpose of the equation 


AX+X'™B=C, we have B'X+X7TAT=C7. Note that o(A(B‘)"')= 
o( BT A'). Moreover, Au # 1 for any A, u € o( BT A") is equivalent to 2u 4 1 for any 
4, u € o(A(B")~'). Thus, we have the following corollaries. The proof of these 
corollaries is similar to the above theorems and is omitted here. 


Corollary 10.1. Supposed that B is nonsingular, let 
9(1,,a(Bry) (8) = det — sA(BT)~*) = ans" + +++ +ay8+09,a =1, (10.1.10) 
and 


adj(I, — sA(B?)*) := ®,_1s"- ++ --» +@,s+@p. (10.1.11) 


(1) If the equation (10.0.1) has solution, then the solution can be stated as 


n-1 
Xg, apn (BAT) = (BT) X @ (C7 — CB“ AT)(BAT)*. (10.1.12) 


i 


ll 
© 


162 Solutions to Linear Matrix Equations and Their Applications 


(2) IfAw 1 for any 2, u € o(A(B*)~'), then the unique solution to (10.0.1) can be 
characterized by 


n—1 
xX =(Bry? bs @(C? — CB ATABA”) g7! gpn- (B™A"). (10.1.13) 


Corollary 10.2. Supposed that B is nonsingular and 44, H, ..., Hp are the eigenval- 


ues of A(B?)7!. 


(1) Let X be a solution to (10.0.1), then the solution can be summarized as 


= (BT)? SE pA (oT = COB" AT)(B1A")!, (10.1.14) 


(2) Let uiu; A 1 for all i,j, then the unique solution to (10.0.1) can be characterized 


with 
n-1 j : . 
X= (BT) SOS BABI) YC? - CBA) BAT) 
== (10.1.15) 
—1 —1,T 
x Ig, agna B A ). 


Corollary 10.3. Supposed that B is nonsingular and C? — CBA? = C1 C2, C1 € 
R", Co E€ R™", where r = rank(C? — CBA"). 


(1) Let X be a solution to (10.0.1), then the solution can be characterized with 
-14T 
Aira A] 


— (RT)-1 T)-1 yaa E (10.1.16) 
(BT) Q,(A(BT)™*, C1, n)S,(I, A(B7)) Q,(B1 AT, Ca, n). 


(2) Let Au 4 1 for any 4, u € o(A(BT)™'), then a unique solution to (10.0.1) is 


X = (BIY QLA(BTY, C1, n) S(T, A(BT)*)Q,(BAA™, Co, n) 97 apn) y(B1A?). 


(10.1.17) 


10.1.2 The Second Case: A and B are Nonsingular 
Theorem 10.4. Let A and B be nonsingular, 


hpr a- (8) = det(sIn _ BT A`’) = Ve + a +V1S+ Vos Yn = 1, (10.1.18) 
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and 


adj(sI, — B?A~') := D,_1s" 14 +--+ Dis + Do. (10.1.19) 


(1) Supposed that X is a solution to the equation (10.0.1), then the solution can be 
characterized with 
n—1 
Xhgr aa (BA") = A X Di(CB7 A" — C7)(B ATY. (10.1.20) 
i=0 


(2) Ifo(B?A~')No(B"!A*) = Ø, then the equation (10.0.1) has a unique solution 


n—1 


X= a`] pest At — CTAB A") x [hpr (BAT. (10.1.21) 


Proof. According to definition (10.1.18), the equation (10.0.1) can be rewritten as 
Syl(sI„, — B A+, BOAT, AX) = CB ATC". 
By definitions (10.1.18) and (10.1.19), the above relation is equivalent to 
[sIn — B? A“']vec(AX) = vec(CB1 A? — C”). 
It follows from lemma 10.2 that 
®[I,det(sI, — B? A~*)|vec(AX) = ®[adj(sI,, — B? A~')|vec(CB-! A? — C”). 
So we get 
Syl(I,det(sI,, — BTA), BAT, AX) = Syl(adj(sI, — B? A‘), BAT, CBA" — C”). 
From definition (10.1.18) and some simple computations, we have 
Syl(I,det(sI, — B?A~'), B-1A?, AX) = AXhgr,1(B1A?*), 
and 


Syl(adj(sIn — B' A"), BA", CBA" — C*) =) | D(CB'A™ — C7)(B" AT). 


Thus, we get 


n—1 
Xhgr y (BAT) = AS” Di(CBA" — C7)(B ATY. 
B'A 
i=0 
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Therefore, (10.1.20) has been proved. Due to o(B?A~')No(B!A’) =Ø, 
hgr,(B-1A*) is nonsingular and the equation (10.0.1) has a unique solution. So 
(10.1.21) holds. o 

Next, the well-known Faddeev-Leverrier algorithmľ®®! is shown as follows: 


Diy = D448 AS + nko rin Dn = 0, k= 1, 2, vey Ny 


ae gee 10.1.22 
race(Dn-k ) yn = 1,k=1,2,...,7. ( ) 


Yn-k = k , 


Based on this Faddeev-Leverrier algorithm, we have the equivalent forms of 
theorem 10.4. The proof of that is similar to theorems 10.2 and 10.3 and it is omitted 
here. 


Theorem 10.5. Supposed that A and B are nonsingular. 
(1) If X is a solution of the equation (10.0.1), then the solution can be stated as 


n k-1 
Xhgrya (BAT) = AXO XO (BTA (CBAT — C)B AT). (10.1.23) 


k=1 j=0 


(2) Ifo(B?A~')No(B"!A*) = Ø, then the equation (10.0.1) has a unique solution 


n k-1 
X= apd WAIORA — OT)(BAT)FF4] ph (BOAT). 
k=1 j=0 


(10.1.24) 


Remark 3. Different from theorem 10.4, in order to obtain the solution to (10.0.1), 


this theorem only needs the coefficients of the characteristic polynomial of BT A™'. 
Besides the Faddeev-Leverrier algorithm, there exist other numerically reliable 
algorithms which can also be applied. 


Theorem 10.6. Supposed that A and B are nonsingular, let CB"! A? — CT = emer 
hold, Ć1 € R™", Cz € R™", where r = rank(CB"! A? — C7). 


(1) If X is a solution to the equation (10.0.1), then the solution can be 
expressed as 


Xhgr,(B1A‘) = A'Q,(B7 A, Ci, n)S,(B7A')Q,(BA™, Co, mn). (10.1.25) 


(2) Ifo(B?A~')No(B!A") = Ø, then the equation (10.0.1) has a unique solution 


X=A'Q,(BTA™, C,n)S,(B7A")Q,(B1A", Co, n)h5t,1(B-1A7). (10.1.26) 
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10.2 Solutions to the Generalized Sylvester Transpose 
Matrix Equation 


In this section, we discuss the parametric solutions to the equation (10.0.2). Firstly, 
we define 


fu, -aBn (4) := det(I + sA! BT) = Ôn” + +++ + ê1Ss+ ôo, Ôo = 1; (10.2.1) 
and 


adj(In + sA! BT) := Mn-18"! + --- + Mis + Mo. 10.2.2 
j 


Theorem 10.7. If A is nonsingular and {s|det(I + sA~'B") = 0} N e(-(47!)" B) = 
© holds, then all the solutions to the equation (10.0.2) are stated as 


n-1 5 
X = © M,A1C2Z(-(A71)"B)' 
g= 
n—1 g 
+ © A`! (—-BTA™!)'(M;A~ CZ)" (—B), 
i=0 
Y = Zfa, -apn (-(4®) 7B). 


(10.2.3) 


Proof. First, we’ll prove that X and Y given in (10.2.3) are the solutions to (10.0.2). 
By calculation we get 


AX+X'B 


-AÑ MA7 CZ((47! B+ SCB I(M;A`™1 CZ)" B 


i=0 i=0 


+A 5. A`!(—BTA!(M;A ~! CZ)" (=) 


+ $X (B) (M;A™ CZ)(-(A~™')" B (47) "B 

= 5 AM;A™!CZ(-(A7)) B) — ŞB) M,a CZ(-(A7!)T B) +! 
i=0 i=0 

= AMA! CZ + Sam: + BTR A CZ(-(47!) 7 BY 


eB? Mai Am CZ(-(A7!)T By" 
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Note that (I, + sA-'B*)adj(I, + sA BT) = I,det(I, + sA" BT), we have 
Mo = 60Ln, 
M,;+A ‘BTR. = òin, i€ I[1,n—1], 
A BT Mni = dnl. 


Thus, one get 


n-1 y 
AMA™CZ+ Ņ (AM;+ B™M,_,)A1CZ(—-(A!)"B)'+ BT M„-147'CZ(—(A7!) TB)" 


= CZY ò(-(A™) TB) = CZfu, apn (-(4) B) = CY. 


Therefore, X and Y in (10.2.3) are satisfied to (10.0.2). 
Next, we will prove the completeness of (10.2.3). Firstly, it is showed that (10.2.3) 
has rp parameters which are represented by the elements of the parametric matrix 


Z. Secondly, because {s|det(I,, + s4~'B?) =0}No(—-BTA™) =Ø holds and 
fu,-aoan(-(4”) TB) is nonsingular, this demonstrates that the mapping 
Z — (X, Y) given in (10.2.3) is injective. So all the solutions to (10.0.2) can be 
characterized by (10.2.3). oO 

In the following, we’ll give two equivalent forms of (10.2.3), one of which is stated 
as the controllability matrix associated with A`! BT and A`! C, symmetric operator 


matrix, and the observability matrix associated with (A~')"B and Z. Using this 
form, convenience and advantages may be provided for further analyzing control 
problem. 


Theorem 10.8. If A is nonsingular and {s|det(I„ + sA-+B") = 0} N o(-(47})" B) 
= Ø holds, then all the solutions to the equation (10.0.2) can be characterized by 


n—l i 


X= a A fs OZ(—(A7!)T B) + A7! 


i=0 k= 


x [E aana] (CB), A 


=0 k0 
Y =Zf 1 -A7 B”) (-(A71)*B), 


or 
X =Q,(—A™'B", A™ C, n)8,(1, —A'B") Q,(—(A') "B, Z, n) 
AO (AB A Ce ATR) 


x Q.(-(A~*) TB, Z)] T(-B), 
Y =Zf i1, -47 B") (-(A7')*B), 


(10.2.5) 


where Z € R”*” is an arbitrary chosen parameter matrix. 
y p 
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Proof. From (10.1.5), one derive 


Mo = In 
M; =A BTM +ailn, i€I[i,n—1], 
t —A™ BTM; 
p U- getin) 
l 


This relation can be compactly expressed as 


Mo = Ln, 
Mı = 6,1, +(—A™‘B?*), 
My = ô2In + ôĉ1(—A7!BT) + (—A1BTY, 


Mycol fees Pt a ey 


Also it can be rewritten as 


Mi=Ņ ðA BT), 69 = 1,4=1,2,...,.n-1. 
k=0 


Thus, by (10.2.3) we get 


n—1 n—1 i 
XC M;A™ CZ(-(A™')" BY = ôk(— A7! BT)" AT! CZ(-(A7})" BY. 
i=0 i=0 k=0 
and 
n=l nl i J 
XC- BTA Y (MiA O2)" = (XOY (ABTA OZ- (A7) *B)' 
i0 i=0 k=0 
Moreover, from (10.2.3) we have 
n—1 
XC M,A~\CZ(-(A*)*B)' 
i=0 
= Q-A BT, AT! C, n)S,(I, —A~'B*) Q,(-(A“*) TB, Z, n), 
and 
n—1 ; 
A` Y (BTA) (M; A~! CZ)" (-B) 
i=0 
=A QA BTA 0 iA BTA "B, Z, n)|"(—B). 
Therefore, the desired result follows. O 


Suppose that B is nonsingular, we have the following results. Due to the line of 
the proof is similar to theorems 10.7 and 10.8, here it is omitted. 
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Theorem 10.9. Supposed that B is nonsingular and {sldet(I+sA (B-')*) = 0} 
(\o(—A* B7!) = Ø holds, let 


fur,,-atp-y?) (8) = det(In + 8A(B7!)*) = Ons" + +++ +018+@0,% l, (10.2.6) 
and 
adj(I, + sA(B-!)*) := Nps"! + ++ + Nast No, (10.2.7) 
then all the solutions to the equation (10.0.2) can be expressed as 


_ l B Laxa T n—-1 “wr l se T 
X=Y [nica ATB) + (BDN CZ)(-A"B®' (A), TT 


T p-l 
Y = Zf, -agn (-47B7')B. 
where Z € R”*” is an arbitrary chosen parameter matrix. 


Theorem 10.10. Supposed that B is nonsingular and {s|det(Z + sA(B71)") = 0} 
(\o(—A’ B7!) = Ø holds, then all the solutions to the equation (10.0.2) can be 
stated as 


n—-1 i ; -T 
p22 or(—A(B71) T) CZ(—-AT By 


n—1 7 m ; 10.2.9 
+P Vale ee y uea 0029) 
i=0 k=0 
Y =Zf yay (-A BB, 


or 
X = [Q,(-A(B“)", C,n)8,(1,-A(B)")Q,(-A"B™, 2)) 
+ (BYT Q,(-A(B-))”, C,n)5,(, -A(B)") 
Q,(-ATB", Z, n)| (-A)7, 
Y= Zf, -a857 (47 BB, 


(10.2.10) 


where Z € R”*%” is an arbitrary chosen parameter matrix. 
y p 


10.3 Algorithms for Solving Two Transpose Equations 
and Numerical Example 


Through the discussion of sections 10.1 and 10.2, it is shown that the solutions to 
(10.0.1) and (10.0.2) can be constructed according to the presented new results. In 
this section, three algorithms are proposed for computing the solutions to (10.0.1) 
and (10.0.2). 
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Algorithm 10.1. (For equation (10.0.1). Case 1: A is nonsingular.) 


e Step 1. Find the decomposition of the matrix C — (BTA o)", obtain Cı and 
Cz, then compute Q.(BTA™!, C1, n) and Q (BTA), C2, n). 

e Step 2. Compute A‘, BTA! and fara(s), find 01, 02,...,%n, then calculate 
S,(I, BA“) and fa, gr4-y((B7A™")”). 

e Step 3. Find the solution to the equation (10.0.1) by the formula (10.1.8); For any 
1,u€0(B'A"), if Au, then compute MaE AT obtain the 
unique solution of the equation (10.0.1) by the formula (10.1.9). 


Algorithm 10.2. (For equation (10.0.1). Case 2: A and B are nonsingular.) 


e Step 1. Find the decomposition of the matrix ca At — CT, obtain Gi and Cai 
then compute Q. (BTA, Ce n) and OB AY, Ce, n). 

e Step 2. Compute B-',B™A™! and hpry-(s), find Y1, Y2,- - Yn; then calculate 
gpr,(B tA‘) and S,(BT A). 

e Step 3.Find the solution to the equation (10.0.1) by the formula (10.1.24); If 
o(B™ A~')No(B! A‘) = Ø, compute h5t (B7'A7), then calculate the unique 
solution of the equation (10.0.1) by the formula (10.1.26). 


Remark 4. If fgr4-1(s) := det(sIn — B'A™')') = Das’, then fa, gry-y(s) = 
det(I, — sB A!) = 7"_a:8""'. Because the order of the coefficients in fpr 4-1(s), 
i.e. 09, 01,---,O%n, is opposite to that of fa, gta (8). 


Remark 5. If B is nonsingular, it has an algorithm similar to algorithm 10.1 and 
here is omitted. If A is nonsingular, we can obtain the solution to (10.0.1) by 
algorithm 10.1 or algorithm 10.2. Similarly, if B is nonsingular, the solution to 
(10.0.1) can also be obtained by two algorithms. 


Example 10.1. We consider the explicit solution to the Sylvester transpose matrix 
equation in the form of (10.0.1) with the following parameters: 


3 11 -1 = 4 0 -19 19 24 
A=|2 10 8 |, B=|1 -3 6], C=[ 16 7 12 
1 0 1 2 3 -7 13 —22 33 


The first method: by algorithm 10.1 
By simple computation, the eigenvalues of the matrix BTA! are as follows: 


Ay = 0.1468, 22 = —1.2951 + 1.73627, Ag = —1.2951 — 1.73622. 


It is easy to check that 2;4; Æ 1,7,7 =1,2,3. So the equation (10.0.1) has a 
unique solution. From algorithm 10.1, by some computations, we have 
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0.0616 —0.1953 —0.0275 
—0.0772 0.1558 0.1045 
0.0313 —0.0282 —0.0553 
—0.0541 —0.0904 0.2142 

Q,((B? A7!)", Cy,3) = 10? x | —0.0346 0.4590 —0.3641 |, 
0.0394 —0.2537 0.1559 
—0.2376 1.0221 —0.4373 
0.5390 —1.7938 0.4641 
—0.2563 0.7784 —0.1455 


fa, Bra (8) = —0.68875° + 4.31138" + 2.44348+ 1, 


0 
4], 
6 


[ss —107.7931 se 


1 1 
C — (BTA! C)" = C1 C2, C1 = k 2 
4 5 


Ca = | —36.6366 —24.4032 3.8939 


38.8859 25.5013  —62.1857 


Is 2.443473 4.311313 
S3(I, BA") = | 0s Is 2.4434] |, 
03 03 Is 


and 


Q(B AS, C1, 3) 
1.0000 1.0000 0 —4.3019 —4.6226 
0 2.0000 4.0000 18.5660 22.7925 
4.0000 5.0000 6.0000 —7.0000 —10.0000 


27.0943 —36.3265 —51.2004 —70.7682 


—4.7170 = 14.5867 19.1912 24.7896 
—14.0000 0.4151 3.9811 9.7358 


Thus, by theorem 10.3, the unique solution to the equation (10.0.1) is 


0.9999 2.0007 —3.0005 
X = {| —2.0000 —0.0001 6.0001 |. 


3.0000 5.9999 0.0001 
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The second method: by algorithm 10.2 
Similarly, the eigenvalues of the matrix B’A™' can be obtained by simple 
computation: 


yı = 0.1468, yp = —1.2951 + 1.7362i, y3 = —1.2951 — 1.7362i. 


Due to y; #1,i, j= 1,2,3, equation (10.0.1) has a unique solution. By 
algorithm 10.2, by some computations one gets 


OB AT — C7 = C10, 
gpt a(s) = 8° + 2.44348" + 4.31138 — 0.6887, 


27.8192 94.7192 6.1628 
—9.3914 46.5595 2.4884 
-8.2260 —12.6490 21.9535 
—41.8461 —10.1242 —21.4734 
Q,(B 1A, C2,3)= | 49.0233 42.0930 12.7442 |, 
—10.3864 —44.8060 —4.9685 
—229.5391 —330.9403 —21.2978 
296.5836 431.9032 33.9439 
—130.3930 —171.9269 —19.7306 


. 1 2 3 p 27.8192 —94.7192 6.1628 
Cy=|0 4 —1 |,C2= | -9.3914 46.5595 2.4884 |, 
4 5 2 —8.2260 —12.6490 21.9535 


4.311313 2.4434Ī; Iz 
S3(BT A) = | 2.44341, I; 0; l, 
Is 03 03 


and 


Q(B? A", C1,3) 
1.0000 2.0000 3.0000 —4.3019 —4.1509 
0 4.0000 —1.0000 18.5660 22.2830 
4.0000 5.0000 2.0000 —7.0000 —10.0000 


9.3113 —36.3265 —51.1255 —4.1192 


—3.0660 14.5867 18.9066 4.4538 
—0.5000 0.4151 4.7075  —6.7217 
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Thus, by theorem 10.6, the unique solution to equation (10.0.1) is 


0.9999 2.0001 —3.0004 
X = į —2.0000 —0.0001 6.0000 
2.9999 5.9999 0.0000 


Algorithm 10.3. (For equation (10.0.2). Case: A is nonsingular.) 

e Step 1. Compute A‘, A™'BT and AC, then calculate Q.(—A~'B*, AC, n). 

e Step 2. Compute feanen (8), find 61,62,...,6n, then calculate fa, -47 B") 
((A~1)"B) and S,(I, 41 BT). 


e Step 3. Choose a parameter matrix Z, then compute OA) B, Z, n). 
e Step 4. Find a solution to the equation (10.0.2) by the formula (10.2.5). 


Remark 6. If B is nonsingular, it has a similar algorithm to algorithm 10.3 and here 
is omitted. 


Example 10.2. In this example, we consider the parametric solutions to equa- 
tion (10.0.2) with the following parametric matrices: 


4 11 -2 10 -1 9 4 
21 0 80 2 6 7 12 
A= ,C = ; 
1 10 11 2 3 -2 3 12 
2 3 21 4 2 3 23 12 
—11 42 10 2 
12 -23 6 3 
B= 
21 30 —-17 2 
23 1 0 2 


By some computations, we get 


fastan (s) = 1.80485“ + 6.77178 + 6.03065? +2.8223s+ 1. 


Choose Z as 


111.2117 794.7075 233.5488 188.2771 
13.8692 149.9002 40.5172 33.7128 
2.1329 5.5192 2.4184 1.6934 
—1.6508 —10.8792 —3.9105 —2.6594 


Z= 
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Q(-A?B?, A*C,4) 
0.1776 0.4605 —3.4495 —2.2801 0.3487 —2.1196 
0.2278 0.4081 —1.0575 0.6707 0.3064 —0.2802 
0.1280 0.0622 0.9770 0.5987 0.0380 0.2143 
—0.2539 1.1523 3.1384 0.4940 —0.6225 —0.3245 
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—4.7172 0.4709 
6.4886 3.3105 
2.7520 1.2676 

—16.4958 —9.2827 


0.6664 1.4451 23.7628 10.9121 —2.2126 5.9847 —11.4997 —15.9334 
—0.5057 = 2.7668 5.6111 —0.4947 —0.9304 —1.9951 —33.2165 —15.8537 


—0.3162 0.7060 —2.7953 —2.7906 0.1772 —1.9370 —8.2816 —1.2043 


, 


1.5943 —5.1792 2.9494 10.8548 0.2810 8.1124 57.9738 17.0626 


and 


111.2117 794.7075 233.5488 
13.8692 149.9002 40.5172 
2.1329 5.5192 2.4184 
—1.6508 —10.8792 —3.9105 

—23.4868 —283.6510 —73.5257 
5.4046 —57.8579 —10.6996 

—2.1652 —0.5315 —1.0392 
0.1456 1.3795 1.1643 
0.5917 106.0737 11.5955 

—15.4207 25.8637 —1.5306 
3.7945 —1.1908 0.5386 

—3.0130 5.3683 1.5835 
19.2898 —101.3619 —6.4952 
24.7008  —18.7178 6.5999 

—5.2777 = — 1.8355 = — 1.8841 
9.0960 0.1991 —0.6903 


Q.(-(A")"B, Z, 4) = 


188.2771 
33.7128 
1.6934 
—2.6594 
—65.3330 
—10.6265 
—0.7826 
0.9756 
18.9204 
1.5146 
0.5077 
—0.0638 
—4.6183 
2.4232 
—0.7852 
0.2245 


Thus, by theorem 10.6, the parametric solutions to equation (10.0.2) are 


1 20 3 2 

3 5 6 8 
a 0 2 6 7 Y’ 

8 9 3 -2 


and 


—0.7857 187.2857 96.7143 89.5000 


Y= 


34.1853 48.5108 27.6114 20.4951 


—11.7356 —4.7634  —1.4671 —0.2488 
32.2445 —14.1288 —10.9599 —2.4803 


174 Solutions to Linear Matrix Equations and Their Applications 


10.4 Application in Control Theory 


As an application of the proposed solution to (10.0.1), in this section, we consider 
the continuous zeroing dynamics (CZD) design of the time-varying linear system. 
The design formula expressed in matrix form is defined as 


L(t) = —A.JMP o (L(t)), (10.4.1) 
and JMP(-) : R”*” — R”*" is denoted as an array of jmp functions: 
jmp(lii(t)) jmp(lha(t)) +++ gjmp(lin(t)) 
jmp(la(t)) — jmp(loa(t)) +++ gmp(lon(t)) 
JMP(L(t)) = ; . , (10.4.2) 
jmp(lm(t)) jmp(lna(t)) + gmpUnn(t)) 
where jmp(lj;(t)) = { ; 4 . . And the time derivative is 
L(t) = A()X(t) + A()X(t) + X(t)" B(t) + X(t)" BC). (10.4.3) 


Substituting (10.4.1) into (10.4.3) and arranging, one has the following 
time-varying linear system 


A(t) X(t) + X(t)" B(t) = CH, (10.4.4) 


where A(t), B(t), C(t) € R"*” are smoothly time-varying matrices, X(t) € R”*” is 
the unknown time-varying matrix to be determined. Besides, t € [0, t;|C[0, +00), 
and ty denotes the final time. Thus, the equation (10.4.4) is equivalent to the 
equation AX + XTB = C. We choose the following parametric matrices: 


A = triu(rand(10, 10), 1) + diag(1 + diag(rand(10))), B = tril(rand(10, 10), 1), 


12.0308 7.4456 2.1117 1.9960 7.4386 
3.3343 13.8946 5.5906 2.7438 7.0838 
5.7489 3.8058 8.8902 3.5619 1.1289 
1.9270 4.5679 4.6981 15.0807 6.2074 
3.4261 4.5089 4.4524 5.6138 8.3613 
2.3090 7.7085 6.0933 4.2581 4.6963 
6.9273 3.3946 7.0041 3.2479 2.0214 
6.1090 3.4464 8.7568 5.7667 3.7945 
4.8700 3.0501 3.8442 6.3470 5.2390 
6.8190 3.2828 4.2765 5.4472 3.3497 
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3.4554 2.4897 5.3519 4.1122 7.8176 
6.5278 5.5624 5.6862 4.1144 8.9310 
5.0187 5.8117 3.1962 4.9426 7.1911 
4.7645 5.5780 5.5443 4.5838 4.7910 
7.7872 1.9622 3.9063 6.6722 5.1343 
11.0492 5.5616 2.6473 7.4494 1.7236 
2.1400 12.2184 9.0972 5.3937 3.9903 
2.8991 5.5384 10.8941 7.6649 2.5836 
2.3227 3.3837 5.7356 14.7296 1.9510 
1.9376 2.6750 6.7963 2.3251 10.0195 


It is easy to check that ny Æ 1 for any y,y € o(B’ A”) and A is nonsingular. 
Therefore, the equation AX + XTB = C has a unique solution. It follows from 
algorithm 10.1 that the unique solution to AX + XTB = C is 


6.0000 0.1544 0.5975 0.1249 0.7593 0.1636 0.8092 0.0205 0.7519 0.3174 
0.0000 6.0000 0.3353 0.0244 0.7406 0.6660 0.7486 0.9237 0.2287 0.8145 
0.0000 0.0000 6.0000 0.2902 0.7437 0.8944 0.1202 0.6537 0.0642 0.7891 
0.0000 0.0000 0.0000 6.0000 0.1059 0.5166 0.5250 0.9326 0.7673 0.8523 
0.0000 0.0000 0.0000 0.0001 6.0000 0.7027 0.3258 0.1635 0.6712 0.5056 
0.0000 0.0000 0.0000 —0.0000 0.0000 6.0000 0.5464 0.9211 0.7152 0.6357 
0.0000 0.0000 0.0000 0.0000 0.0001 0.0000 6.0000 0.7947 0.6421 0.9509 
0.0000 0.0000 0.0000 -—0.0001 0.0000 0.0000 0.0000 6.0000 0.4190 0.4440 
0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 6.0000 0.0600 
0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 6.0000 


10.5 Conclusions 


In this chapter, we have studied the explicit solutions to the equations AX + XTB = 
C and AX + XTB = CY, which are named the Sylvester transpose matrix equation 
and the generalized Sylvester transpose matrix equation. The work of this chapter 
has the following contributions. 


e Three forms of solutions to the Sylvester transpose matrix equation are provided. 
One of the solutions is the well-known Jameson’s Theorem. Two algorithms are 
proposed for computing the solutions to this equation. 

e Compared with the necessary and sufficient conditions for the existence of 
solutions to the Sylvester transpose matrix equation inlt63], the condition in this 
chapter only needs to check the eigenvalues of BT A™+. Moreover, there is no limit 
to all the coefficient matrices, while in@ 63) it requests a coefficient matrix 
=C. 

e As an application of the proposed algorithm for the equation AX + XTB = C, 
the continuous zeroing dynamics (CZD) design of a time-varying linear system is 
given. 
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e Parametric solutions to the generalized Sylvester transpose matrix equation have 
been constructed. An algorithm for obtaining the parametric solutions has been 
proposed. 

e The idea in this chapter is also applicable to some other matrix equations with 
similar structures, e.g., the Stein transpose matrix equation X + AX’ B= C and 
generalized Stein transpose matrix equation X + AX’ B= CY. What we need is 
to make some small changes of specific coefficients with respect to X7. 
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